server2.duniastreaming.site
robots.txt

Robots Exclusion Standard data for server2.duniastreaming.site

Resource Scan

Scan Details

Site Domain server2.duniastreaming.site
Base Domain duniastreaming.site
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-06-23T12:39:11+00:00
Next Scan 2025-07-23T12:39:11+00:00

Last Successful Scan

Scanned2025-05-02T12:37:33+00:00
URL https://server2.duniastreaming.site/robots.txt
Redirect https://bokepindolive.xyz/robots.txt
Redirect Domain bokepindolive.xyz
Redirect Base bokepindolive.xyz
Domain IPs 104.21.44.130, 172.67.199.253, 2606:4700:3032::6815:2c82, 2606:4700:3032::ac43:c7fd
Redirect IPs 104.21.54.16, 172.67.222.55, 2606:4700:3037::6815:3610, 2606:4700:3037::ac43:de37
Response IP 172.67.222.55
Found Yes
Hash b3d8f2dd4968e41905707d50d1d00762ae1aa394f8133f00de1ab8453d9f76b8
SimHash 6214fcd1d7d3

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /cgi-bin/
Disallow /login
Disallow /download
Disallow /videodownload
Disallow /search
Disallow /search_ind
Disallow /search_asd
Disallow /search_chinese
Disallow /search_jav
Allow /images/
Allow /images_asd/

ahrefsbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

Other Records

Field Value
sitemap http://bokepindolive.xyz/sitemap.xml

Comments

  • Allow search engines to access images
  • Slow down some aggressive bots
  • Sitemap references