Log In Sign Up

afaqs.com
robots.txt

Robots Exclusion Standard data for afaqs.com

Resource Scan

Scan Details

Site Domain afaqs.com
Base Domain afaqs.com
Scan Status Ok
Last Scan2024-09-08T17:32:52+00:00
Next Scan 2024-10-08T17:32:52+00:00

Last Scan

Scanned2024-09-08T17:32:52+00:00
URL https://afaqs.com/robots.txt
Redirect https://www.afaqs.com/robots.txt
Redirect Domain www.afaqs.com
Redirect Base afaqs.com
Domain IPs 23.20.179.164, 54.158.195.16
Redirect IPs 104.18.90.198, 104.18.91.198, 104.18.92.198, 104.18.93.198, 104.18.94.198, 2606:4700::6812:5ac6, 2606:4700::6812:5bc6, 2606:4700::6812:5cc6, 2606:4700::6812:5dc6, 2606:4700::6812:5ec6
Response IP 104.18.93.198
Found Yes
Hash 5f3fa3ec2f5236d3b76831a7648b95b2f8994eddb7c8e8751630899c741b6329
SimHash c05c945207b3

Groups

*

Rule Path
Allow /
Disallow /shell.html

semrush

Rule Path
Disallow /

ahref

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

claude

Rule Path
Disallow /

open ai

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.afaqs.com/sitemap.xml
sitemap https://www.afaqs.com/news_sitemap.xml
Back to top