fishinginsydney.com
robots.txt

Robots Exclusion Standard data for fishinginsydney.com

Resource Scan

Scan Details

Site Domain fishinginsydney.com
Base Domain fishinginsydney.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-04-21T11:33:04+00:00
Next Scan 2024-06-20T11:33:04+00:00

Last Successful Scan

Scanned2024-02-22T09:40:35+00:00
URL https://fishinginsydney.com/robots.txt
Domain IPs 104.21.14.89, 172.67.158.136, 2606:4700:3031::ac43:9e88, 2606:4700:3036::6815:e59
Response IP 104.21.14.89
Found Yes
Hash b2f3dcc34846869c3a18346feb2046ca40af351c9cd7e4d694eff4cbe74dcfb5
SimHash 48089a628d53

Groups

*

Rule Path
Disallow /cache
Allow /

Other Records

Field Value
sitemap https://fishinginsydney.com/sitemap.xml

Warnings

  • 3 invalid lines.