www.library.fullerton.edu
robots.txt

Robots Exclusion Standard data for www.library.fullerton.edu

Resource Scan

Scan Details

Site Domain www.library.fullerton.edu
Base Domain fullerton.edu
Scan Status Ok
Last Scan2025-04-02T16:31:24+00:00
Next Scan 2025-05-02T16:31:24+00:00

Last Scan

Scanned2025-04-02T16:31:24+00:00
URL https://www.library.fullerton.edu/robots.txt
Domain IPs 137.151.141.210
Response IP 137.151.141.210
Found Yes
Hash 0ac1389fe51e8a798d018c6b00f47148844bd28b6d31db76e41eb6727308fa1f
SimHash 4b100001d593

Groups

archive.org_bot

Rule Path
Disallow

popetech-crawlbot

Rule Path
Disallow

popetech-scanbot

Rule Path
Disallow

*

Rule Path
Disallow /
Allow /index.html
Allow /find/*
Allow /giving/*
Allow /borrow/*
Allow /about/*
Allow /study-make/*
Allow /faculty-staff/*
Allow /hours-events/*
Allow /help/*
Allow /sitemap.xml
Allow /sitemap.txt

Other Records

Field Value
sitemap https://www.library.fullerton.edu/sitemap.txt
sitemap https://library.fullerton.edu/sitemap.txt