gizia.com
robots.txt

Robots Exclusion Standard data for gizia.com

Resource Scan

Scan Details

Site Domain gizia.com
Base Domain gizia.com
Scan Status Ok
Last Scan2024-09-21T20:49:14+00:00
Next Scan 2024-10-21T20:49:14+00:00

Last Scan

Scanned2024-09-21T20:49:14+00:00
URL https://gizia.com/robots.txt
Domain IPs 161.156.100.100
Response IP 161.156.100.100
Found Yes
Hash e2a64cf2ead8c46e95622b342f562a3e87a072265bc5969ecda80dcc8cb98190
SimHash 03161572c303

Groups

*

Rule Path
Allow /
Disallow /Y/
Disallow /Y/*
Disallow /AsiriYogunluk.php
Disallow /ajax.php
Disallow /Cache/GelismisVitrin/
Disallow /srv/campaign-v2
Disallow /?Kid
Disallow /Diger/Apps/Facebook.php
Disallow /srv/service/site/get-cookie-law
Disallow /*?brand=*
Disallow /*%26brand%3D*
Disallow /*?category=*
Disallow /*%26category%3D*
Disallow /*?fbclid=*
Disallow /*%26fbclid%3D*
Disallow /*?gclid=*
Disallow /*%26gclid%3D*
Disallow /*?lang=*
Disallow /*%26lang%3D*
Disallow /*?model=*
Disallow /*%26model%3D*
Disallow /*?multi=*
Disallow /*%26multi%3D*
Disallow /*?price=*
Disallow /*%26price%3D*
Disallow /*?q=*
Disallow /*%26q%3D*
Disallow /*?sort=*
Disallow /*%26sort%3D*
Disallow /*?stock=*
Disallow /*%26stock%3D*
Disallow /*?type1=*
Disallow /*%26type1%3D*
Disallow /*?type2=*
Disallow /*%26type2%3D*
Disallow /*?view=*
Disallow /*%26view%3D*
Disallow /*%26pg%3D*
Disallow /order*

mail.ru_bot

Rule Path
Disallow /

barkrowler

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

cfnetwork

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

seznambot

Rule Path
Disallow /

cubot

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

butterfly

Rule Path
Disallow /

exabot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

w3c-checklink

Rule Path
Disallow /

w3c_validator

Rule Path
Disallow /

w3c_css_validator

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

faviconizer

Rule Path
Disallow /

a6-indexer/1.0

Rule Path
Disallow /

nutch

Rule Path
Disallow /

pingdom

Rule Path
Disallow /

proximic

Rule Path
Disallow /

python

Rule Path
Disallow /

searchmetricsbot

Rule Path
Disallow /

sogou web spider

Rule Path
Disallow /

sogou spider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

youdaobot

Rule Path
Disallow /

sosospider

Rule Path
Disallow /

spbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

yie8

Rule Path
Disallow /

turnitinbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

hivabot

Rule Path
Disallow /

nerdybot

Rule Path
Disallow /

updown_tester

Rule Path
Disallow /

androiddownloadmanager

Rule Path
Disallow /

voltron

Rule Path
Disallow /

xenu's link sleuth 1.1c

Rule Path
Disallow /

obot

Rule Path
Disallow /

riddler

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.gizia.com/xml/sitemap/sitemap.xml
sitemap https://www.gizia.com/xml/sitemap/sitemap1.xml
sitemap https://www.gizia.com/xml/sitemap/sitemap2.xml

Comments

  • Gizia robots.txt
  • 30.01.2024
  • sitemaps
  • rules
  • crawlers

Warnings

  • 2 invalid lines.