topsofthetop.com
robots.txt

Robots Exclusion Standard data for topsofthetop.com

Resource Scan

Scan Details

Site Domain topsofthetop.com
Base Domain topsofthetop.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-07-20T00:21:51+00:00
Next Scan 2025-09-18T00:21:51+00:00

Last Successful Scan

Scanned2025-04-28T12:55:32+00:00
URL https://topsofthetop.com/robots.txt
Domain IPs 109.234.161.166
Response IP 109.234.161.166
Found Yes
Hash 21dd83ea21850d157ba87ba57c231aed24adfdba0e2138764750d219f40516f0
SimHash 530d9840a137

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /
Disallow /
Disallow /

google-extended

Rule Path
Disallow /

textbulkerbot

Rule Path
Disallow /

jarsidebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://topsofthetop.com/sitemap_index.xml

Warnings

  • `useragent` is not a known field.