Information About Search Engine Crawlers

The Penn State Search Engine http://search.psu.edu/ uses the following IP address and User-Agent HTTP header for crawling new Web sites:

Search Appliance	Hostname / IP address	User-Agent string
Google Search Appliance, 4.x series	search-crawler.aset.psu.edu / 128.118.142.19	PennStateSpider (http://aset.its.psu.edu/googledocs/crawler_info.html)

For more information on the Penn State Search Engine, please review the documentation.

---

The Pennsylvania State University ©2007. All rights reserved.
Alternative Media - Nondiscrimination Statement
This site maintained by Academic Services and Emerging Technologies, a unit of Information Technology Services.

Comments and suggestions may be directed to The Penn State Search Engine Support Team.

Last revised: Thursday, May 3, 2007.