Log In Sign Up

findifyhub.com
robots.txt

Robots Exclusion Standard data for findifyhub.com

Resource Scan

Scan Details

Site Domain findifyhub.com
Base Domain findifyhub.com
Scan Status Ok
Last Scan2025-08-07T06:52:33+00:00
Next Scan 2025-08-14T06:52:33+00:00

Last Scan

Scanned2025-08-07T06:52:33+00:00
URL https://findifyhub.com/robots.txt
Redirect https://www.findifyhub.com/robots.txt
Redirect Domain www.findifyhub.com
Redirect Base findifyhub.com
Domain IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Redirect IPs 104.21.112.1, 104.21.16.1, 104.21.32.1, 104.21.48.1, 104.21.64.1, 104.21.80.1, 104.21.96.1, 2606:4700:3030::6815:1001, 2606:4700:3030::6815:2001, 2606:4700:3030::6815:3001, 2606:4700:3030::6815:4001, 2606:4700:3030::6815:5001, 2606:4700:3030::6815:6001, 2606:4700:3030::6815:7001
Response IP 104.21.16.1
Found Yes
Hash 5f24baf2239bdac886ee74a95920a4174d9b0af7872d12cfb26e07ae233d72a3
SimHash 6d34d6f2fe42

Groups

mediapartners-google

Rule Path
Disallow

*

Rule Path
Disallow /search
Disallow /editor/
Disallow /admin/
Disallow /crontab/
Disallow /backend/
Disallow /app/
Disallow /front/
Disallow /api/
Disallow /cdn-cgi/
Disallow /wp-content/
Disallow /go/
Disallow /go-*.html*
Disallow /verify_robots
Disallow /rsslist/
Disallow /rss-*.xml
Disallow /websetting/
Disallow /image-chirashi/
Disallow /impr/
Disallow /click/
Disallow /*?*sort=
Disallow /*?promoid=*

dotbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /
Back to top

Warnings

  • 2 invalid lines.
Back to top