rajeshsatpute.com
robots.txt

Robots Exclusion Standard data for rajeshsatpute.com

Resource Scan

Scan Details

Site Domain rajeshsatpute.com
Base Domain rajeshsatpute.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-09-12T19:05:21+00:00
Next Scan 2025-12-11T19:05:21+00:00

Last Successful Scan

Scanned2024-07-27T18:48:46+00:00
URL https://rajeshsatpute.com/robots.txt
Domain IPs 65.0.158.91
Response IP 65.0.158.91
Found Yes
Hash 8869ff420f1934722733261bef5a67c5ed9f876d10c87443b95ff5d0fe6acdcf
SimHash 8d1c84e2cd33

Groups

*

Rule Path
Disallow /ajax/
Disallow /Ajax/
Disallow /ajaxpages/
Disallow /Ajaxpages/
Disallow /admin/
Disallow /Admin/
Disallow /files/
Disallow /Files/
Disallow /MobileApp/
Disallow /mobileapp/
Disallow /*.JPEG
Disallow /*.JPG
Disallow /*.PNG
Disallow /*.PDF
Disallow /*.TIFF
Disallow /*.TIF
Disallow /*.HTM
Disallow /*.HTML
Disallow /*.BMP
Disallow /*.XLS
Disallow /*.XLSX
Disallow /*.dat
Disallow /*.csv
Disallow /*.DOCX
Allow /*.js
Allow /*.CSS
Allow /*.css

flashget

Rule Path
Disallow /

offline

Rule Path
Disallow /

teleport

Rule Path
Disallow /

downloader

Rule Path
Disallow /

reaper

Rule Path
Disallow /

webzip

Rule Path
Disallow /

website quester

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

fast-webcrawler

Rule Path
Disallow /

gulliver

Rule Path
Disallow /

webcapture

Rule Path
Disallow /

httrack

Rule Path
Disallow /

fetch api request

Rule Path
Disallow /

netants

Rule Path
Disallow /

superbot

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

wget

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

msproxy/2.0

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

ms frontpage

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /