bitnewsbot.com
robots.txt

Robots Exclusion Standard data for bitnewsbot.com

Resource Scan

Scan Details

Site Domain bitnewsbot.com
Base Domain bitnewsbot.com
Scan Status Ok
Last Scan2025-12-29T08:10:23+00:00
Next Scan 2026-01-05T08:10:23+00:00

Last Scan

Scanned2025-12-29T08:10:23+00:00
URL https://bitnewsbot.com/robots.txt
Domain IPs 191.101.228.174, 2a02:4780:84:1786:6b23:2b81:cdae:abf6, 2a02:4780:84:d94b:c325:d6c:4004:638b, 77.37.66.197
Response IP 77.37.48.9
Found Yes
Hash faa12006f7b15336ec28b72021f34e8a660815082cf0a3e1eaaaed3bc254f3f8
SimHash 62089862cab3

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

adsbot-google

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

Other Records

Field Value
sitemap http://bitnewsbot.com/sitemap_index.xml