allthingsgoodand.com
robots.txt

Robots Exclusion Standard data for allthingsgoodand.com

Resource Scan

Scan Details

Site Domain allthingsgoodand.com
Base Domain allthingsgoodand.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-29T16:32:08+00:00
Next Scan 2025-09-27T16:32:08+00:00

Last Successful Scan

Scanned2023-05-10T13:29:36+00:00
URL https://allthingsgoodand.com/robots.txt
Domain IPs 130.211.40.170
Response IP 130.211.40.170
Found Yes
Hash 7fab9c3b5c5d561786a2b15b1ede453d1caf37ea77c1d2bacfe98702f2482459
SimHash ec384ca6f612

Groups

spinn3r

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /thanks
Disallow */listing/*/similar

Other Records

Field Value
sitemap https://www.allthingsgoodand.com/sitemaps.xml?sitemap=blogs&offset=0
sitemap https://www.allthingsgoodand.com/sitemaps.xml?sitemap=pages&offset=0

Comments

  • \
  • -----
  • | . . |
  • -----
  • \--|-|--/
  • | |
  • |-------|