picwish.com
robots.txt

Robots Exclusion Standard data for picwish.com

Resource Scan

Scan Details

Site Domain picwish.com
Base Domain picwish.com
Scan Status Ok
Last Scan2024-09-20T04:36:14+00:00
Next Scan 2024-09-27T04:36:14+00:00

Last Scan

Scanned2024-09-20T04:36:14+00:00
URL https://picwish.com/robots.txt
Domain IPs 104.21.29.74, 172.67.148.149, 2606:4700:3034::ac43:9495, 2606:4700:3037::6815:1d4a
Response IP 172.67.148.149
Found Yes
Hash b5e9501a567aa864879f5e20ebe1a0055d7c612891ca803d7f123f1cc151b102
SimHash 4924d8127a12

Groups

twitterbot
*

Rule Path
Disallow /sitemapGenerator/
Disallow /pad/
Disallow /forum/faq.php
Disallow /support/admin/
Disallow /support/admin/
Disallow /support/license/
Disallow /support/applysite/
Disallow /support/news/
Disallow /support/newsletter/
Disallow /support/onlineform/
Disallow /support/update/
Disallow /support/upload/
Disallow /online/
Disallow /store/
Disallow /forum/ucp.php?mode=login
Disallow /forum/ucp.php?mode=terms
Disallow /forum/ucp.php?mode=register
Disallow /forum/ucp.php?mode=privacy
Disallow /forum/ucp.php?mode=sendpassword
Disallow /pad/
Disallow /cgi-bin/
Disallow /go/
Disallow /stats/
Disallow /dh_
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /contact/
Disallow /author/
Disallow /page/
Disallow /archives/
Disallow /date/
Disallow /wp-images/
Disallow /backup/
Disallow /banners/
Disallow /trackback/
Disallow /feed/
Disallow /*/feed/
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*?
Disallow /*?*
Disallow /*.php$
Disallow /*.php*
Disallow /*.inc$
Disallow */feed/
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow */trackback/
Disallow */trackback*
Disallow /category/*
Disallow /wp-*
Disallow /wget/
Disallow /httpd/
Disallow /tag/
Disallow /i/
Disallow /f/
Disallow /t/
Disallow /c/
Disallow /j/

googlebot

Rule Path
Disallow /feed/$
Disallow /*/feed/$
Disallow /*/feed/rss/$
Disallow /*/trackback/$
Disallow /*/*/feed/$
Disallow /*/*/feed/rss/$
Disallow /*/*/trackback/$
Disallow /*/*/*/feed/$
Disallow /*/*/*/feed/rss/$
Disallow /*/*/*/trackback/$
Disallow /*.php$
Disallow /*.inc$
Disallow /*.wmv$
Disallow /*.avi$
Disallow /*.cgi$
Disallow /*.txt$

mediapartners-google

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

ia_archiver-web.archive.org

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap http://picwish.com/sitemap.xml