screwman.co.za
robots.txt

Robots Exclusion Standard data for screwman.co.za

Resource Scan

Scan Details

Site Domain screwman.co.za
Base Domain screwman.co.za
Scan Status Ok
Last Scan2024-07-07T15:07:18+00:00
Next Scan 2024-08-06T15:07:18+00:00

Last Scan

Scanned2024-07-07T15:07:18+00:00
URL https://screwman.co.za/robots.txt
Domain IPs 41.72.159.82
Response IP 41.72.159.82
Found Yes
Hash 382ee3d7ba3e3333c97688fc8071d565b94200d87a92ff7cf6f399e364de106e
SimHash 047572409553

Groups

googlebot

Rule Path
Disallow

baidu spider

Rule Path
Disallow

msn bot/bingbot

Rule Path
Disallow

yandex bot

Rule Path
Disallow

soso spider

Rule Path
Disallow

exabot

Rule Path
Disallow

sogou spider

Rule Path
Disallow

google plus share

Rule Path
Disallow

facebook external hit

Rule Path
Disallow

google feedfetcher

Rule Path
Disallow

googlebot

Rule Path
Disallow

baidu spider

Rule Path
Disallow

msn bot/bingbot

Rule Path
Disallow

yandex bot

Rule Path
Disallow

soso spider

Rule Path
Disallow

exabot

Rule Path
Disallow

sogou spider

Rule Path
Disallow

google plus share

Rule Path
Disallow

facebook external hit

Rule Path
Disallow

google feedfetcher

Rule Path
Disallow

Warnings

  • 4 invalid lines.