news.bestdeals.today
robots.txt

Robots Exclusion Standard data for news.bestdeals.today

Resource Scan

Scan Details

Site Domain news.bestdeals.today
Base Domain bestdeals.today
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-06-22T21:47:14+00:00
Next Scan 2024-09-20T21:47:14+00:00

Last Successful Scan

Scanned2023-08-28T20:52:47+00:00
URL https://news.bestdeals.today/robots.txt
Domain IPs 172.64.166.30, 172.64.167.30, 2606:4700:e4::ac40:a61e, 2606:4700:e4::ac40:a71e
Response IP 172.64.166.30
Found Yes
Hash 46c540754e9bf28b731b3cab9fa4f5ecc93ce9904041ad516fb2251e3f18d80f
SimHash 21041b60c711

Groups

adsbot-google

Rule Path
Disallow

grapeshot

Rule Path
Disallow

gptbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.bestdeals.today/sitemap.xml