Log In Sign Up

gretnagreen.com
robots.txt

Robots Exclusion Standard data for gretnagreen.com

Resource Scan

Scan Details

Site Domain gretnagreen.com
Base Domain gretnagreen.com
Scan Status Ok
Last Scan2024-10-08T12:30:42+00:00
Next Scan 2024-11-07T12:30:42+00:00

Last Scan

Scanned2024-10-08T12:30:42+00:00
URL https://gretnagreen.com/robots.txt
Redirect https://www.gretnagreen.com/robots.txt
Redirect Domain www.gretnagreen.com
Redirect Base gretnagreen.com
Domain IPs 104.21.39.86, 172.67.170.23, 2606:4700:3030::ac43:aa17, 2606:4700:3037::6815:2756
Redirect IPs 104.21.39.86, 172.67.170.23, 2606:4700:3030::ac43:aa17, 2606:4700:3037::6815:2756
Response IP 172.67.170.23
Found Yes
Hash cdf785b15c08502483a529c64c4480b8c900fcd345cb1bac80cba81efdbbaa08
SimHash 6f05d802ee92

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

rogerbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

searchmetrics

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

addthis

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

tweetmemebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

seznambot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

baidu

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

baiduspider

Rule Path
Disallow /wedding-calc.php
Disallow /wedding-calc.php*
Disallow /wedding-calc.php?plum_shop=true
Disallow *?plum_shop=*
Disallow /calculator?cx=*
Disallow /?q=*
Disallow /index.php?q=*
Disallow /q.php*
Disallow /_/templates/mobile/js/app.js
Disallow /templates/mobile/font/IMFeDPrm29P.ttf

Other Records

Field Value
crawl-delay 20

weborama-fetcher

Rule Path
Disallow /

weborama

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

searchmetrics

Rule Path
Disallow /

petalbot

Rule Path
Disallow /
Back to top

Other Records

Field Value
sitemap https://www.gretnagreen.com/sitemap.xml
Back to top

Comments

  • New Server
  • Stop Wedding Calculator "JSON" from being crawled by Search Engines
  • Stop Search Pages from being crawled
  • Stop 404 URL's that keep getting crawled from being constanly crawled by Search Engines
Back to top