Log In Sign Up

secure.payu.com
robots.txt

Robots Exclusion Standard data for secure.payu.com

Resource Scan

Scan Details

Site Domain secure.payu.com
Base Domain payu.com
Scan Status Ok
Last Scan2024-11-03T07:07:29+00:00
Next Scan 2024-12-03T07:07:29+00:00

Last Scan

Scanned2024-11-03T07:07:29+00:00
URL https://secure.payu.com/robots.txt
Domain IPs 65.9.112.102, 65.9.112.124, 65.9.112.19, 65.9.112.99
Response IP 108.156.22.60
Found Yes
Hash c87238f2ffb41c1676b73c6366d59b6d19e2e599cc1383309e9929f0eeb1b593
SimHash b8f9f2a04bd5

Groups

*

Rule Path
Disallow /

teleport

Rule Path
Disallow /

teleportpro

Rule Path
Disallow /

cherrypicker

Rule Path
Disallow /

emailcollector

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

webbandit

Rule Path
Disallow /

emailwolf

Rule Path
Disallow /

extractorpro

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

telesoft

Rule Path
Disallow /

webzip/4.0

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

websauger

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

netants

Rule Path
Disallow /

mister pix

Rule Path
Disallow /

webauto

Rule Path
Disallow /

www-collector-e

Rule Path
Disallow /

harvest/1.5

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

backdoorbot/1.0

Rule Path
Disallow /

emailsiphon

Rule Path
Disallow /

psbot/0.1

Rule Path
Disallow /

psbot

Rule Path
Disallow /

picpirate

Rule Path
Disallow /

picturestealer

Rule Path
Disallow /

picture

Rule Path
Disallow /

picturepirate

Rule Path
Disallow /

picturegrabber

Rule Path
Disallow /

picgrabber

Rule Path
Disallow /

website copier

Rule Path
Disallow /

httrack website copier

Rule Path
Disallow /

httrack website copier/3.x

Rule Path
Disallow /

httrack website copier/3.x [xr&co'2003]

Rule Path
Disallow /
Back to top