bdnews72.xyz
robots.txt

Robots Exclusion Standard data for bdnews72.xyz

Resource Scan

Scan Details

Site Domain bdnews72.xyz
Base Domain bdnews72.xyz
Scan Status Ok
Last Scan5/23/2025, 4:26:52 PM
Next Scan 5/30/2025, 4:26:52 PM

Last Scan

Scanned5/23/2025, 4:26:52 PM
URL https://bdnews72.xyz/robots.txt
Domain IPs 104.21.19.36, 172.67.184.242, 2606:4700:3033::ac43:b8f2, 2606:4700:3034::6815:1324
Response IP 104.21.19.36
Found Yes
Hash 9296354c623ff398aae0a4a91f0c6f8eb11a0345b6ce5dd6fccc58a0fa80f6f7
SimHash 612cce028bb2

Groups

*

Rule Path
Disallow /wp-admin/
Allow /wp-admin/admin-ajax.php
Disallow /feed
Disallow /tag

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

*

Rule Path
Disallow /wp-content/uploads/wpo/wpo-plugins-tables-list.json

Other Records

Field Value
sitemap https://bdnews72.xyz/sitemap_index.xml