princetonherald.com
robots.txt

Robots Exclusion Standard data for princetonherald.com

Resource Scan

Scan Details

Site Domain princetonherald.com
Base Domain princetonherald.com
Scan Status Ok
Last Scan2024-10-28T18:38:31+00:00
Next Scan 2024-11-27T18:38:31+00:00

Last Scan

Scanned2024-10-28T18:38:31+00:00
URL https://princetonherald.com/robots.txt
Domain IPs 104.21.71.33, 172.67.142.200, 2606:4700:3032::ac43:8ec8, 2606:4700:3036::6815:4721
Response IP 172.67.142.200
Found Yes
Hash ea5c3f70af38458ca95a533bab7f0fc2ef448ef883c5bab8264af47269cb6866
SimHash 655c5dd1cf16

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://princetonherald.com/nordicityrue.xml
sitemap https://princetonherald.com/devourersvba.xml
sitemap https://princetonherald.com/camailsydb.xml
sitemap https://princetonherald.com/amentiygb.xml
sitemap https://princetonherald.com/srgkpf.xml
sitemap https://princetonherald.com/administrationalvbr.xml
sitemap https://princetonherald.com/entoilsymy.xml
sitemap https://princetonherald.com/outdropmkk.xml
sitemap https://princetonherald.com/cofeaturedut.xml
sitemap https://princetonherald.com/bombingsdxk.xml
sitemap https://princetonherald.com/skairtjx.xml
sitemap https://princetonherald.com/misauthorizedtdz.xml
sitemap https://princetonherald.com/nonsurgicallypyo.xml
sitemap https://princetonherald.com/trustilyrez.xml
sitemap https://princetonherald.com/gelexycg.xml
sitemap https://princetonherald.com/sitemap.xml