bunda4d1.monster
robots.txt

Robots Exclusion Standard data for bunda4d1.monster

Resource Scan

Scan Details

Site Domain bunda4d1.monster
Base Domain bunda4d1.monster
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-02-25T02:16:28+00:00
Next Scan 2025-04-26T02:16:28+00:00

Last Successful Scan

Scanned2024-12-05T02:15:08+00:00
URL https://bunda4d1.monster/robots.txt
Redirect https://bunda4dx1.com/robots.txt
Redirect Domain bunda4dx1.com
Redirect Base bunda4dx1.com
Domain IPs 104.21.46.56, 172.67.223.228, 2606:4700:3030::ac43:dfe4, 2606:4700:3037::6815:2e38
Redirect IPs 104.21.93.139, 172.67.210.220, 2606:4700:3035::6815:5d8b, 2606:4700:3036::ac43:d2dc
Response IP 104.21.93.139
Found Yes
Hash 7eeb7e18f56ca305b8dd01a2dd1af0027cfc64e87496909c5167dd37531622a7
SimHash 095081b75791

Groups

*

Rule Path
Allow /

dmca.com page protection crawling service

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-video

Rule Path
Allow /

bingbot

Rule Path
Allow /

slurp

Rule Path
Allow /

duckduckbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

yahoo pipes 1.0

Rule Path
Allow /

yahoo! slurp

Rule Path
Allow /

yandexbot

Rule Path
Allow /

yandeximages

Rule Path
Allow /

yandexnews

Rule Path
Allow /

yandexwebmaster

Rule Path
Allow /

yandexpagechecker

Rule Path
Allow /

zyborg

Rule Path
Allow /

exabot

Rule Path
Allow /

facebot

Rule Path
Allow /

ia_archiver

Rule Path
Allow /

archive.org_bot

Rule Path
Allow /

architextspider

Rule Path
Allow /

feedfetcher-google

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

Other Records

Field Value
sitemap https://bunda4dpro.com/sitemap.xml

Warnings

  • 2 invalid lines.