claimspages.com
robots.txt

Robots Exclusion Standard data for claimspages.com

Resource Scan

Scan Details

Site Domain claimspages.com
Base Domain claimspages.com
Scan Status Ok
Last Scan2024-05-28T07:40:11+00:00
Next Scan 2024-06-04T07:40:11+00:00

Last Scan

Scanned2024-05-28T07:40:11+00:00
URL https://www.claimspages.com/robots.txt
Domain IPs 20.22.206.112
Response IP 20.22.206.112
Found Yes
Hash ca073ed2beacf0c5e1c2c8fcf6c72a195165bd4de7c89cfbc890786906c7128c
SimHash d00cc060ae11

Groups

petalbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot/7.0

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.claimspages.com/sitemaps/main.xml