pratishkumar.com
robots.txt

Robots Exclusion Standard data for pratishkumar.com

Resource Scan

Scan Details

Site Domain pratishkumar.com
Base Domain pratishkumar.com
Scan Status Ok
Last Scan2024-09-25T14:23:33+00:00
Next Scan 2024-10-02T14:23:33+00:00

Last Scan

Scanned2024-09-25T14:23:33+00:00
URL https://pratishkumar.com/robots.txt
Redirect https://www.pratishkumar.com/robots.txt
Redirect Domain www.pratishkumar.com
Redirect Base pratishkumar.com
Domain IPs 139.84.134.58
Redirect IPs 139.84.134.58
Response IP 139.84.134.58
Found Yes
Hash 7f3d190443b47c80a8813c10d7aa79333294f0e8036c6e2b48eddd3d53be5d68
SimHash cf67ce20d4b0

Groups

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.pratishkumar.com/wp-sitemap.xml

Comments

  • Block bots that don't benefit us.
  • Allow all other bots