Log In Sign Up

aviparshan.com
robots.txt

Robots Exclusion Standard data for aviparshan.com

Resource Scan

Scan Details

Site Domain aviparshan.com
Base Domain aviparshan.com
Scan Status Ok
Last Scan2024-10-06T09:57:23+00:00
Next Scan 2024-11-05T09:57:23+00:00

Last Scan

Scanned2024-10-06T09:57:23+00:00
URL https://aviparshan.com/robots.txt
Redirect https://www.aviparshan.com/robots.txt
Redirect Domain www.aviparshan.com
Redirect Base aviparshan.com
Domain IPs 13.215.144.61, 2406:da18:880:3800::c8, 2406:da18:b3d:e200::64, 46.137.195.11
Redirect IPs 13.228.199.255, 18.139.194.139, 2406:da18:880:3800::c8, 2406:da18:b3d:e200::64
Response IP 52.74.166.77
Found Yes
Hash 0984b29509ca33de6facc179409381ac260705e3f3b807d1db08e51ee099c384
SimHash 312ccbf2889e

Groups

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /
Disallow /

claudebot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

*

Rule Path
Disallow /404.html
Disallow /israeldeals/redirect.html
Disallow /israeldeals/fb
Disallow /israeldeals/signal
Disallow /israeldeals/twitter
Disallow /israeldeals/instagram
Disallow /israeldeals/whatsapp
Disallow /israeldeals/message
Disallow /fb/*
Disallow /js/*
Disallow /israeldeals/js/*
Disallow /jct/index.html
Disallow /jct/test.html
Disallow /original/*
Allow /
Back to top

Other Records

Field Value
sitemap https://www.aviparshan.com/sitemap.xml
Back to top

Comments

  • Disallow: /img/lev/*
  • Noindex: /img/lev/*
Back to top

Warnings

  • `noindex` is not a known field.
  • `‍user-agent` is not a known field.
Back to top