secrettantric.com
robots.txt

Robots Exclusion Standard data for secrettantric.com

Resource Scan

Scan Details

Site Domain secrettantric.com
Base Domain secrettantric.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-11T14:38:05+00:00
Next Scan 2025-08-09T14:38:05+00:00

Last Successful Scan

Scanned2024-03-25T14:35:11+00:00
URL https://secrettantric.com/robots.txt
Domain IPs 104.26.6.122, 104.26.7.122, 172.67.68.109
Response IP 104.26.6.122
Found Yes
Hash 00ceb0c95879321c017313f753cdf2e3474a0b7948f05210a5a7befe592d5a50
SimHash 6a98de05e3e2

Groups

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-json/
Disallow /fonts/
Disallow /stats/
Disallow /xmlrpc.php
Disallow /page/
Disallow /?s=*

Other Records

Field Value
crawl-delay 10

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 10

bingbot

Rule Path
Disallow /test123/
Disallow /secret/
Disallow /feed/

Other Records

Field Value
sitemap https://www.secrettantric.com/sitemap_index.xml

Comments

  • Allow Bing Bot