hitenchaudhary.com
robots.txt

Robots Exclusion Standard data for hitenchaudhary.com

Resource Scan

Scan Details

Site Domain hitenchaudhary.com
Base Domain hitenchaudhary.com
Scan Status Ok
Last Scan2024-11-17T01:26:29+00:00
Next Scan 2024-11-24T01:26:29+00:00

Last Scan

Scanned2024-11-17T01:26:29+00:00
URL https://hitenchaudhary.com/robots.txt
Redirect https://xoilaccc.us/robots.txt
Redirect Domain xoilaccc.us
Redirect Base xoilaccc.us
Domain IPs 104.18.4.46, 104.18.5.46, 2606:4700::6812:42e, 2606:4700::6812:52e
Redirect IPs 104.18.12.188, 104.18.13.188, 2606:4700::6812:cbc, 2606:4700::6812:dbc
Response IP 104.18.12.188
Found Yes
Hash 33946b6697064a3e820191012d2f96620feccdaae67f3674116db0348bfb3fdb
SimHash cb7479ea6e13

Groups

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

webzip

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

web downloader

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

offline explorer pro

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

offline commander

Rule Path
Disallow /

leech

Rule Path
Disallow /

websnake

Rule Path
Disallow /

blackwidow

Rule Path
Disallow /

http weazel

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin
Disallow /wp-admin
Disallow /wp-includes
Disallow /wp-content/cache
Disallow /wp-content/plugins
Disallow /wp-json/
Disallow /wp-login.php
Disallow /wp-register.php
Disallow /xmlrpc.php
Disallow /license.txt
Disallow /readme.html
Disallow /trackback/
Disallow /comments/feed/
Disallow /*?replytocom
Disallow */rss
Disallow /author/
Disallow /?
Disallow /*?
Disallow /?s=
Disallow *%26s%3D
Disallow /search
Disallow /search/
Disallow *?attachment_id=
Disallow *utm%3D
Disallow */embed
Disallow /archive/
Disallow /wp-cron.php
Disallow /wp-load.php
Disallow /wp-login.php*
Disallow /customize.php*
Allow /wp-admin/admin-ajax.php
Allow /wp-includes/*.css
Allow /wp-includes/*.js
Allow /wp-content/plugins/*.css
Allow /wp-content/plugins/*.js
Allow /*.css
Allow /*.js

googlebot

Rule Path
Disallow /feed/
Disallow /feed$
Disallow /*/feed$
Disallow /feed

Comments

  • Googlebot