Log In Sign Up

git.ir
robots.txt

Robots Exclusion Standard data for git.ir

Resource Scan

Scan Details

Site Domain git.ir
Base Domain git.ir
Scan Status Ok
Last Scan2024-09-07T03:26:19+00:00
Next Scan 2024-10-07T03:26:19+00:00

Last Scan

Scanned2024-09-07T03:26:19+00:00
URL https://git.ir/robots.txt
Domain IPs 87.236.209.116
Response IP 87.236.209.116
Found Yes
Hash e273d882dedd5b747b1e668aa19f80a83ff37369b95f842f859cea3f2945707b
SimHash cc0fcc20d7f0

Groups

*

Rule Path
Disallow /cart/
Disallow /admin/*
Disallow /api/*
Disallow /notifications/
Disallow /notifications/*
Disallow /profile/*
Disallow /invoice/*
Disallow /courses/*
Disallow /p/*
Disallow /aj-*/
Disallow /media/download-links/*

nuclei
wikido
riddler
petalbot
zoominfobot
go-http-client
node/simplecrawler
cazoodlebot
dotbot/1.0
gigabot
barkrowler
blexbot
magpie-crawler
voltron
bytespider
gptbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://git.ir/sitemap.xml
Back to top

Comments

  • --------------------------------
  • Ban bots that don't benefit us.
Back to top

Warnings

  • 1 invalid line.
Back to top