Log In Sign Up

tutorialphp.net
robots.txt

Robots Exclusion Standard data for tutorialphp.net

Resource Scan

Scan Details

Site Domain tutorialphp.net
Base Domain tutorialphp.net
Scan Status Ok
Last Scan6/19/2025, 4:06:11 PM
Next Scan 6/26/2025, 4:06:11 PM

Last Scan

Scanned6/19/2025, 4:06:11 PM
URL https://tutorialphp.net/robots.txt
Domain IPs 74.208.48.83
Response IP 74.208.48.83
Found Yes
Hash ec32464a3aa7adbd813f72fc338a9bcad7b8efd7ca2482969da6fac3d8a326af
SimHash a3144514eb60

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

ia_archiver

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver-web.archive.org

Rule Path
Disallow /

*

Rule Path
Disallow
Back to top

Other Records

Field Value
sitemap https://tutorialphp.net/sitemap.xml
Back to top

Comments

  • Directivas para el bot de Bing para que deje un
  • delay (especificado en segundos) entre peticiones.
  • También se especifica el intervalo de horas en las
  • que se le permite hacer el crawl de la web
  • Bloqueamos Alexa y archive.org
  • Sitemap
Back to top

Warnings

  • `visit-time` is not a known field.
Back to top