squaredealonline.com
robots.txt

Robots Exclusion Standard data for squaredealonline.com

Resource Scan

Scan Details

Site Domain squaredealonline.com
Base Domain squaredealonline.com
Scan Status Ok
Last Scan2025-12-22T17:53:13+00:00
Next Scan 2026-01-21T17:53:13+00:00

Last Scan

Scanned2025-12-22T17:53:13+00:00
URL https://squaredealonline.com/robots.txt
Domain IPs 108.138.199.116, 108.138.199.20, 108.138.199.4, 108.138.199.76
Response IP 3.169.71.26
Found Yes
Hash c88ca74970e34abd777c995956f1114b1f57e87a0c01a96fdd0bf6eb56734dbc
SimHash d83090a9eae2

Groups

*

Rule Path
Disallow /A
Disallow /AT
Disallow /Acc
Disallow /AccThumb
Disallow /Admin
Disallow /cgi-bin
Disallow /images
Disallow /Jakob
Disallow /javascript
Disallow /sitewide
Disallow /Testing
Disallow /addtocart.asp
Disallow /a.asp
Disallow /changecart.asp
Disallow /cart.asp
Disallow /showpic.asp
Disallow /sp.asp
Disallow /checkout.asp
Disallow /search_advanced.asp
Disallow /emptycart.asp
Disallow /changepassword.asp
Disallow /massentry.asp
Disallow /gb.asp
Disallow /b.asp
Disallow /browse.csv
Disallow /faq.asp
Disallow /up.asp
Disallow /la.asp
Disallow /la.csv
Disallow /WebFiles/*
Disallow /checkout_pmnt.asp
Disallow /checkout_editpmnt.asp
Disallow /checkout_ship.asp
Disallow /checkout_editship.asp
Disallow /checkout_ttl.asp
Disallow /confirmation.asp
Disallow /last_adds.asp
Disallow /nlast_adds.asp
Disallow /nla.asp
Disallow /la.asp
Disallow /wholesale_application.asp

slysearch

Rule Path
Disallow /

npbot

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

mauibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

zoominfobot

Rule Path
Disallow /

zoominfobot (zoominfobot at zoominfo dot com)

Rule Path
Disallow /

admantx

Rule Path
Disallow /

heritrix

Rule Path
Disallow /

mozilla/3.0 (compatible; indy library)

Rule Path
Disallow /

indy library

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

phpcrawl

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

seoscanners.net

Rule Path
Disallow /

softsearch.ru robot

Rule Path
Disallow /

uptimebot

Rule Path
Disallow /

python-urllib

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

python-httplib2

Rule Path
Disallow /

expo9

Rule Path
Disallow /

zumbot

Rule Path
Disallow /

yandex

Rule Path Comment
Disallow / blocks access to whole site for Yandex

eventmachine httpclient

Rule Path
Disallow /

maxpointcrawler

Rule Path
Disallow /

nutch

Rule Path
Disallow /

maxpointcrawler/nutch-1.10

Rule Path
Disallow /

go-http-client

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

go 1.1 package http

Rule Path
Disallow /

wget

Rule Path
Disallow /

uipbot

Rule Path
Disallow /

uipbot/1.0 (uipbot@semasio.net)

Rule Path
Disallow /

getintent crawler

Rule Path
Disallow /

panscient.com

Rule Path
Disallow /

bubing

Rule Path
Disallow /

buzzbot

Rule Path
Disallow /

free website submitter/1.0

Rule Path
Disallow /

free website submitter

Rule Path
Disallow /

ltx71 - (http://ltx71.com/)

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

Comments

  • Block ZoominfoBot
  • Block ZoominfoBot
  • Block Admantx Bot
  • Block Heritrix
  • Block Indy Library Bot
  • Block Indy Library Bot
  • Block Mail.Ru
  • Block Majestic-12 Bot
  • Block Moz DotBot
  • Block Moz Rogerbot
  • Block PHPCrawl Bot
  • Block BLEXBot
  • Block Brandwatch's Magpie Crawler
  • Block SeznamBot
  • Block this bot
  • Block SoftSearch Bot
  • Block Uptime Bot
  • Buzzbot: http://www.buzzstream.com

Warnings

  • 2 invalid lines.