Penn State Mark Search Engine documentation Information Technology Services
Documentation Home | User Help | File Types | FAQ | Info. for Web Content Providers | Index Helper | Custom Style Manager | Crawler Info

Information About Search Engine Crawlers

The Penn State Search Engine http://search.psu.edu/ uses the following IP address and User-Agent HTTP header for crawling new Web sites:

Search ApplianceHostname / IP addressUser-Agent string
Google Search Appliance, 4.x series search-crawler.aset.psu.edu / 128.118.142.19 PennStateSpider (http://aset.its.psu.edu/googledocs/crawler_info.html)

For more information on the Penn State Search Engine, please review the documentation.


The Pennsylvania State University ©2007. All rights reserved.
Alternative Media - Nondiscrimination Statement
This site maintained by Academic Services and Emerging Technologies, a unit of Information Technology Services.

Comments and suggestions may be directed to The Penn State Search Engine Support Team.

Last revised: Thursday, May 3, 2007.