Log In Sign Up

dawnupdate.site
robots.txt

Robots Exclusion Standard data for dawnupdate.site

Resource Scan

Scan Details

Site Domain dawnupdate.site
Base Domain dawnupdate.site
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-06-27T18:43:49+00:00
Next Scan 2025-09-25T18:43:49+00:00

Last Successful Scan

Scanned2024-03-05T18:36:11+00:00
URL https://dawnupdate.site/robots.txt
Redirect https://123moviesfree4k.com/robots.txt
Redirect Domain 123moviesfree4k.com
Redirect Base 123moviesfree4k.com
Domain IPs 104.21.26.27, 172.67.135.54, 2606:4700:3033::6815:1a1b, 2606:4700:3035::ac43:8736
Redirect IPs 37.49.229.26
Response IP 37.49.229.26
Found Yes
Hash 22749f05e16e2fb30f2d4854aea6d2256ecc2d7ac63fd3979b972d3c530f1e11
SimHash 0900b5418fb1

Groups

*

Rule Path
Allow /

test-bot

Rule Path
Allow /
Allow /home

black-listed-bot

Rule Path
Disallow /movie/fighter-21%2C6%2C10%2C39%2C47%2C29%2C34%2C16%2C31%2C17/
Disallow /country/%5Bcountry%5D
Disallow /movie/%5Bmovie%5D
Disallow /genre/%5Bgenre%5D
Disallow /search/%5Bsearch%5D
Back to top

Other Records

Field Value
sitemap https://123moviesfree4k.com/sitemap.xml
Back to top

Comments

  • *
  • test-bot
  • black-listed-bot
  • Host
  • Sitemaps
Back to top

Warnings

  • `host` is not a known field.
Back to top