androidheadlines.com
robots.txt

Robots Exclusion Standard data for androidheadlines.com

Resource Scan

Scan Details

Site Domain androidheadlines.com
Base Domain androidheadlines.com
Scan Status Ok
Last Scan2024-11-02T05:43:38+00:00
Next Scan 2024-11-09T05:43:38+00:00

Last Scan

Scanned2024-11-02T05:43:38+00:00
URL https://androidheadlines.com/robots.txt
Redirect https://www.androidheadlines.com/robots.txt
Redirect Domain www.androidheadlines.com
Redirect Base androidheadlines.com
Domain IPs 104.20.40.147, 104.20.41.147, 172.67.33.129
Redirect IPs 104.20.40.147, 104.20.41.147, 172.67.33.129
Response IP 104.20.40.147
Found Yes
Hash 99998e67398e004490d7ecacc28a6fca856467bdc4cd92ea053fba881a770ed0
SimHash 581058208133

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

mozilla/5.0 (compatible;contxbot/1.0)

Rule Path
Disallow

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /