respawnfirst.com
robots.txt

Robots Exclusion Standard data for respawnfirst.com

Resource Scan

Scan Details

Site Domain respawnfirst.com
Base Domain respawnfirst.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-10-01T12:57:55+00:00
Next Scan 2024-10-08T12:57:55+00:00

Last Successful Scan

Scanned2024-09-23T12:30:21+00:00
URL https://respawnfirst.com/robots.txt
Domain IPs 2a02:4780:39:b2a8:fc1:d735:1c67:7d78, 82.197.91.125
Response IP 82.197.91.125
Found Yes
Hash ec747ad0025e1015c2e64b3768de13a494a6ace9e31e7b2ef87e8eec3ed3f0cc
SimHash 38587904c912

Groups

*

Rule Path
Disallow /wp-admin/

*

Rule Path
Disallow /wp-json/

gptbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

siteauditbot

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

splitsignalbot

Rule Path
Disallow /

semrushbot-coub

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://respawnfirst.com/sitemap_index.xml