endplasticwaste.org
robots.txt

Robots Exclusion Standard data for endplasticwaste.org

Resource Scan

Scan Details

Site Domain endplasticwaste.org
Base Domain endplasticwaste.org
Scan Status Ok
Last Scan2024-06-02T12:18:39+00:00
Next Scan 2024-07-02T12:18:39+00:00

Last Scan

Scanned2024-06-02T12:18:39+00:00
URL https://endplasticwaste.org/robots.txt
Domain IPs 104.26.0.36, 104.26.1.36, 172.67.73.18, 2606:4700:20::681a:124, 2606:4700:20::681a:24, 2606:4700:20::ac43:4912
Response IP 172.67.73.18
Found Yes
Hash 59949da6d96e38930c0040bc7eec2ed6d8e22d14ef95e48475436c2e023828b9
SimHash 395c723144c7

Groups

googlebot

Rule Path
Allow /
Disallow /api
Disallow /search
Disallow /site
Disallow /bin/
Disallow /xsl/
Disallow /views/
Disallow /App
Disallow /sitecore

slurp

Rule Path
Allow /
Disallow /api
Disallow /search
Disallow /site
Disallow /bin/
Disallow /xsl/
Disallow /views/
Disallow /App
Disallow /sitecore

yandex

Rule Path
Allow /
Disallow /api
Disallow /search
Disallow /site
Disallow /bin/
Disallow /xsl/
Disallow /views/
Disallow /App

msnbot

Rule Path
Allow /
Disallow /api
Disallow /search
Disallow /site
Disallow /bin/
Disallow /xsl/
Disallow /views/
Disallow /App

bingbot

Rule Path
Allow /
Disallow /api
Disallow /search
Disallow /site
Disallow /bin/
Disallow /xsl/
Disallow /views/
Disallow /App

twitterbot

Rule Path
Allow /*/media/*

facebookexternalhit

Rule Path
Allow /*/media/*

Other Records

Field Value
sitemap https://endplasticwaste.org/aepw-sitemap.xml

Comments

  • Google Search Engine Robot
  • Yahoo! Search Engine Robot
  • Yandex Search Engine Robot
  • Microsoft Search Engine Robot
  • Bing Search Engine Robot
  • Twitter Search Engine Robot
  • Facebook Robot