Log In Sign Up

seremprendedor.info
robots.txt

Robots Exclusion Standard data for seremprendedor.info

Resource Scan

Scan Details

Site Domain seremprendedor.info
Base Domain seremprendedor.info
Scan Status Ok
Last Scan2024-06-28T15:14:19+00:00
Next Scan 2024-07-05T15:14:19+00:00

Last Scan

Scanned2024-06-28T15:14:19+00:00
URL https://seremprendedor.info/robots.txt
Redirect https://www.seremprendedor.info/robots.txt
Redirect Domain www.seremprendedor.info
Redirect Base seremprendedor.info
Domain IPs 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30
Redirect IPs 13.250.129.152, 2406:da18:9d0:143e:8e74:1b1a:98b9:2813, 2406:da18:9d0:143f:29e7:ae24:cfea:e9bb, 54.151.156.30
Response IP 13.250.129.152
Found Yes
Hash 854a20db954a04eabc230d2a1e9fb18aa53f049559540070497d0bbfb7fbb8c4
SimHash 68184912c0a1

Groups

googlebot

Rule Path
Allow /sitemap.xml
Allow /sitemap.xml.gz

*

Rule Path
Disallow /cgi-bin/
Disallow /wp-admin/
Disallow /wp-includes/
Disallow /wp-content/
Disallow /cgi-bin/
Disallow /about
Disallow /contact
Disallow /wp-
Disallow /feed/
Disallow /trackback
Disallow /*.php$
Disallow /*.js$
Disallow /*.inc$
Disallow /*.css$
Disallow /*.gz$
Disallow /*.cgi$
Disallow /*.wmv$
Disallow /*.png$
Disallow /*.gif$
Disallow /*.jpg$
Disallow /*.cgi$
Disallow /*.xhtml$
Disallow /*.php*
Disallow /wp-*
Allow /wp-content/uploads/

Other Records

Field Value
crawl-delay 20

googlebot-image

Rule Path
Allow /*

ia_archiver

Rule Path
Disallow /

duggmirror

Rule Path
Disallow /
Back to top

Comments

  • disallow all files in these directories
  • allow Google ImageBot to search all images
  • disallow archiving site
  • disable duggmirror
Back to top