swimmingpoolsteve.com
robots.txt

Robots Exclusion Standard data for swimmingpoolsteve.com

Resource Scan

Scan Details

Site Domain swimmingpoolsteve.com
Base Domain swimmingpoolsteve.com
Scan Status Ok
Last Scan2024-10-08T10:36:19+00:00
Next Scan 2024-10-15T10:36:19+00:00

Last Scan

Scanned2024-10-08T10:36:19+00:00
URL https://swimmingpoolsteve.com/robots.txt
Redirect https://www.swimmingpoolsteve.com/robots.txt
Redirect Domain www.swimmingpoolsteve.com
Redirect Base swimmingpoolsteve.com
Domain IPs 70.39.248.215
Redirect IPs 70.39.248.215
Response IP 70.39.248.215
Found Yes
Hash 938f94fd5916acf71dd3f86c2a33df8269b9e14c0f046684bbc3a886b50914f6
SimHash c85e48dee2f2

Groups

*

Rule Path
Disallow

awariosmartbot/1.0

Rule Path
Disallow /

brandverity/1.0

Rule Path
Disallow /

duckduckbot-https/1.1

Rule Path
Disallow /

linguee

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blp_bbot

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

blp_bbot/0.1

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

crmnlcrawlagent

Rule Path
Disallow /

cliqzbot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

paperlibot/2.1

Rule Path
Disallow /

df bot 1.0

Rule Path
Disallow /

proximic

Rule Path
Disallow /

dotbot/1.1

Rule Path
Disallow /

adscanner

Rule Path
Disallow /

surdotlybot/1.0

Rule Path
Disallow /

seznambot/3.2

Rule Path
Disallow /

barkrowler/0.9

Rule Path
Disallow /

awariosmartbot/1.0

Rule Path
Disallow /

adsbot/3.1

Rule Path
Disallow /

um-ln/1.0

Rule Path
Disallow /

sundayskyadstxtcrawler/1.0

Rule Path
Disallow /

weborama-fetcher

Rule Path
Disallow /

censysinspect/1.1

Rule Path
Disallow /

blexbot/1.0

Rule Path
Disallow /

ttd-content

Rule Path
Disallow /

yandeximages/3.0

Rule Path
Disallow /

proximic

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ogscrper/1.0.0

Rule Path
Disallow /

grammarly/1.0

Rule Path
Disallow /

yahoo! slurp

Rule Path
Disallow /

python-requests/2.25.0

Rule Path
Disallow /

coccocbot-web/1.0

Rule Path
Disallow /

scrapy/1.5.1

Rule Path
Disallow /

coccocbot-image/1.0

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot/6.1

Rule Path
Disallow /

scrapy/1.1.3

Rule Path
Disallow /

censysinspect/1.1

Rule Path
Disallow /

netcraftsurveyagent/1.0

Rule Path
Disallow /

awariosmartbot/1.0

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

ahrefssiteaudit/6.1

Rule Path
Disallow /

*

Rule Path
Disallow /cgi-bin/

*

Rule Path
Disallow /wp-admin

*

Rule Path
Disallow /wp-config*

*

Rule Path
Disallow /wp-content/themes/*.php

*

Rule Path
Disallow /wp-login.php

*

Rule Path
Disallow /*.asp*

*

Rule Path
Disallow /*.cfm

*

Rule Path
Disallow /*.cgi

*

Rule Path
Disallow /*.%7Cjsp*

*

Rule Path
Disallow /*.pl

*

Rule Path
Disallow /*.py

Other Records

Field Value
sitemap http://www.swimmingpoolsteve.com/sitemap.xml