Crawler

A computer program used to automatically read websites by following hyperlinks. Search engines use the information found by a crawler to index the content of websites.
A B C D E F G H I J K L M N O P Q R S T U V W X Y Z

Free Digital Marketing Insights and Advice

The WSI Inside Edge newsletter is your go-to-place to get tips, tricks and best practices on all things related to digital marketing.


    We are committed to protecting your privacy. For more info, please review our Privacy Policy. You may unsubscribe at any time.