Apple has finally confirmed that they have a web crawler, Applebot which is chiefly used for Siri and Spotlight Suggestions.
Applebot is the in-house web crawler of Apple that is used to help services like Siri and Spotlight on iOS and OS X platforms. Apple has also posted a help document, confirming about its web crawler, Applebot, “Applebot is the web crawler for Apple, used by products including Siri and Spotlight Suggestions. It respects customary robots.txt rules and robots Meta tags. It originates in the 17.0.0.0 net block.
User-agent strings will contain “Applebot” together with additional agent information. For example:
Mozilla/5.0 (Macintosh; Intel Mac OS X 10_10_1) AppleWebKit/600.2.5 (KHTML, like Gecko) Version/8.0.2 Safari/600.2.5 (Applebot/0.1)
If robots instructions don’t mention Applebot but do mention Googlebot, the Apple robot will follow Googlebot instructions.”
A web crawler is an internet bot which is used by search engines that automatically scans and browse the webpages for indexing of information. You can exclude Applebot from searching your site by updating the robots.txt file on your site. AppleBot works similarly to Google’s Googlebot, and Apple instructed developers that it will follow Googlebot instructions if no AppleBot specific instructions are found.
Website managers can contact Apple’s network operations center if they have query or concerns about the crawler, Applebot.
Related Posts...
Social Media UpdatesWhat's Hot
Jun 27th, 2024
On National Doctor’s Day, let’s appreciate the advancements in healthcare, especially the rise of telemedicine. This innovation has revolutionized medical care, making it more convenient and effective. India’s eSanjeevani platform stands out, providing equitable healthcare to all, especially in rural areas. Launched by the Ministry of Health and Family Welfare, eSanjeevani facilitates remote consultations and enhances the quality of care. As telemedicine continues to evolve, driven by technological advancements, it promises to play a crucial role in the future of healthcare, ensuring accessibility and efficiency for everyone.
Read more
May 10th, 2024
Modern moms are turning to tech to make parenting easier. This Mother’s Day, read about apps, gadgets, and online communities helping today’s busy mothers. See how technology is changing motherhood.
Read more
Jan 30th, 2024
There are so many e-commerce platforms these days that it can be rather hard for an uninitiated business owner to make the right decision. However, any experienced business owner will […]
Read more
