bostonswingersdating.com
robots.txt

Robots Exclusion Standard data for bostonswingersdating.com

Resource Scan

Scan Details

Site Domain bostonswingersdating.com
Base Domain bostonswingersdating.com
Scan Status Ok
Last Scan2024-10-03T23:25:15+00:00
Next Scan 2024-10-17T23:25:15+00:00

Last Scan

Scanned2024-10-03T23:25:15+00:00
URL https://bostonswingersdating.com/robots.txt
Domain IPs 104.21.77.25, 172.67.203.223, 2606:4700:3036::6815:4d19, 2606:4700:3036::ac43:cbdf
Response IP 172.67.203.223
Found Yes
Hash 62f3dcc6c6470903cbe5e25c061c882c1449648658217686a9b7a452f1606084
SimHash 400cc460f688

Groups

*

Rule Path
Allow /

*

Rule Path
Disallow /actions

panscient.com

Rule Path
Disallow /

serpstatbot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

netestate

Rule Path
Disallow /

ioncrawl

Rule Path
Disallow /

dotbot
dotbot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.com

Rule Path
Disallow /

blexbot
ahrefsbot
mj12bot
semrushbot
dotbot
babbar
bytespider
amazonbot
serpstatbot
barkrowler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bostonswingersdating.com/sitemap.xml

Comments

  • http://www.website-datenbank.de/
  • http://www.opensiteexplorer.org/dotbot