Log In Sign Up

funnyjourney.com
robots.txt

Robots Exclusion Standard data for funnyjourney.com

Resource Scan

Scan Details

Site Domain funnyjourney.com
Base Domain funnyjourney.com
Scan Status Ok
Last Scan2025-12-06T20:02:19+00:00
Next Scan 2025-12-13T20:02:19+00:00

Last Scan

Scanned2025-12-06T20:02:19+00:00
URL https://funnyjourney.com/robots.txt
Redirect https://www.funnyjourney.com/robots.txt
Redirect Domain www.funnyjourney.com
Redirect Base funnyjourney.com
Domain IPs 104.21.11.77, 172.67.148.138, 2606:4700:3036::6815:b4d, 2606:4700:3037::ac43:948a
Redirect IPs 104.21.11.77, 172.67.148.138, 2606:4700:3036::6815:b4d, 2606:4700:3037::ac43:948a
Response IP 104.21.11.77
Found Yes
Hash 94af903df581e8d0a6414c28667fe453a562639d7b2ecb1d29d895450a3e54b3
SimHash 6114d893a482

Groups

*

Rule Path
Allow /
Allow /index.html
Allow /games/
Allow /about/
Allow /css/
Allow /js/
Allow /img/
Disallow /games-backup/
Disallow /manual-update.js
Disallow /update-games-style.js
Disallow /update-games-style.bat
Disallow /update-games-style.ps1
Disallow /seo-game-optimizer.js
Disallow /*.md$
Disallow /admin/
Disallow /private/
Disallow /temp/
Disallow /.git/
Allow /img/*.jpg
Allow /img/*.png
Allow /img/*.gif
Allow /img/*.webp

Other Records

Field Value
crawl-delay 1

googlebot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1

bingbot

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

slurp

Rule Path
Allow /

Other Records

Field Value
crawl-delay 2

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://funnyjourney.netlify.app/sitemap.xml
Back to top

Comments

  • Important pages for indexing
  • Static assets
  • Block development and testing files
  • Block common administrative paths (if they exist)
  • Allow all images for better SEO
  • Sitemap location
  • Crawl-delay for respectful crawling
  • Special instructions for major search engines
  • Block aggressive crawlers
Back to top