genlookups.com
robots.txt

Robots Exclusion Standard data for genlookups.com

Resource Scan

Scan Details

Site Domain genlookups.com
Base Domain genlookups.com
Scan Status Ok
Last Scan2024-09-30T19:19:58+00:00
Next Scan 2024-10-07T19:19:58+00:00

Last Scan

Scanned2024-09-30T19:19:58+00:00
URL https://genlookups.com/robots.txt
Domain IPs 66.96.145.104
Response IP 66.96.145.104
Found Yes
Hash 817303398db9fce668935b948a701c826b3d927f8e61893dffff430dda4c788b
SimHash 2d08d144e134

Groups

swiftbot

Rule Path
Disallow

*
mediapartners-google

Rule Path
Disallow

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

msnbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

googlebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 7

yandexbot

Rule Path
Disallow /affsearch/
Disallow /affsearch590/
Disallow /affsearchgenlookups/
Disallow /bullet-images/
Disallow /prp/
Disallow /prp2/

Other Records

Field Value
crawl-delay 7