mysterylathe.com
robots.txt

Robots Exclusion Standard data for mysterylathe.com

Resource Scan

Scan Details

Site Domain mysterylathe.com
Base Domain mysterylathe.com
Scan Status Ok
Last Scan2025-08-27T14:00:00+00:00
Next Scan 2025-09-26T14:00:00+00:00

Last Scan

Scanned2025-08-27T14:00:00+00:00
URL https://mysterylathe.com/robots.txt
Domain IPs 130.211.40.170
Response IP 130.211.40.170
Found Yes
Hash e21d71a6b6db1769599982a8b2ba89c8615e935608d2894cfec503a0d2e27722
SimHash ad194414c932

Groups

spinn3r

Rule Path
Disallow /

*

Rule Path
Disallow /api/
Disallow /thanks
Disallow */listing/*/similar

Other Records

Field Value
sitemap https://www.mysterylathe.com/sitemaps.xml?sitemap=listings&offset=0
sitemap https://www.mysterylathe.com/sitemaps.xml?sitemap=blogs&offset=0
sitemap https://www.mysterylathe.com/sitemaps.xml?sitemap=pages&offset=0

Comments

  • \
  • -----
  • | . . |
  • -----
  • \--|-|--/
  • | |
  • |-------|