Log In Sign Up

fittestfreakest.com
robots.txt

Robots Exclusion Standard data for fittestfreakest.com

Resource Scan

Scan Details

Site Domain fittestfreakest.com
Base Domain fittestfreakest.com
Scan Status Ok
Last Scan2024-09-12T07:24:16+00:00
Next Scan 2024-10-12T07:24:16+00:00

Last Scan

Scanned2024-09-12T07:24:16+00:00
URL https://fittestfreakest.com/robots.txt
Redirect https://www.fittestfreakest.com/robots.txt
Redirect Domain www.fittestfreakest.com
Redirect Base fittestfreakest.com
Domain IPs 18.155.68.16, 18.155.68.30, 18.155.68.83, 18.155.68.91, 2600:9000:23d2:3600:19:ab14:7a00:93a1, 2600:9000:23d2:5200:19:ab14:7a00:93a1, 2600:9000:23d2:7200:19:ab14:7a00:93a1, 2600:9000:23d2:a00:19:ab14:7a00:93a1, 2600:9000:23d2:b400:19:ab14:7a00:93a1, 2600:9000:23d2:b800:19:ab14:7a00:93a1, 2600:9000:23d2:bc00:19:ab14:7a00:93a1, 2600:9000:23d2:da00:19:ab14:7a00:93a1
Redirect IPs 18.155.68.16, 18.155.68.30, 18.155.68.83, 18.155.68.91, 2600:9000:23d2:3600:19:ab14:7a00:93a1, 2600:9000:23d2:5200:19:ab14:7a00:93a1, 2600:9000:23d2:7200:19:ab14:7a00:93a1, 2600:9000:23d2:a00:19:ab14:7a00:93a1, 2600:9000:23d2:b400:19:ab14:7a00:93a1, 2600:9000:23d2:b800:19:ab14:7a00:93a1, 2600:9000:23d2:bc00:19:ab14:7a00:93a1, 2600:9000:23d2:da00:19:ab14:7a00:93a1
Response IP 18.155.68.30
Found Yes
Hash b45e57e67fc2d6c34f81585f876c6bb5eefe49299664ffc617f640ab980bcf92
SimHash 6884d60774d3

Groups

*

Rule Path
Allow */launches*
Allow */help*
Allow */page*
Allow */landing*
Allow */affiliates*
Disallow /external/*
Disallow /c/*
Disallow /p/*
Disallow /user*
Disallow /checkout*
Disallow /*?*
Disallow /*.git
Disallow /*.CVS
Disallow /*.csv
Disallow /*.Zip$
Disallow /*.Svn$
Disallow /*.Idea$
Disallow /*.Sql$
Disallow /*.Tgz$
Back to top

Other Records

Field Value
sitemap https://www.fittestfreakest.com/sitemap.xml
sitemap https://www.fittestfreakest.es/sitemap.xml
sitemap https://www.fittestfreakest.it/sitemap.xml
sitemap https://www.fittestfreakest.fr/sitemap.xml
sitemap https://www.fittestfreakest.de/sitemap.xml
sitemap https://www.fittestfreakest.pt/sitemap.xml
Back to top

Comments

  • Allow pages lists and roducts
  • Disable all external requests
  • Disable common folders
  • Disable version control folders and others
Back to top