finnegansweb.com
robots.txt

Robots Exclusion Standard data for finnegansweb.com

Resource Scan

Scan Details

Site Domain finnegansweb.com
Base Domain finnegansweb.com
Scan Status Ok
Last Scan2026-02-17T12:07:53+00:00
Next Scan 2026-03-19T12:07:53+00:00

Last Scan

Scanned2026-02-17T12:07:53+00:00
URL https://finnegansweb.com/robots.txt
Domain IPs 104.21.3.128, 172.67.130.182, 2606:4700:3031::ac43:82b6, 2606:4700:3033::6815:380
Response IP 104.21.3.128
Found Yes
Hash 33d1814d170d4161ca014b199dfefd898f21089e6a2db26c1bc103c739030c49
SimHash 661ccc522683

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://www.finnegansweb.com/sitemap.xml.gz

Comments

  • BEGIN XML-SITEMAP-PLUGIN
  • END XML-SITEMAP-PLUGIN