Log In Sign Up

domainesia.com
robots.txt

Robots Exclusion Standard data for domainesia.com

Resource Scan

Scan Details

Site Domain domainesia.com
Base Domain domainesia.com
Scan Status Ok
Last Scan2024-06-04T05:21:19+00:00
Next Scan 2024-06-18T05:21:19+00:00

Last Scan

Scanned2024-06-04T05:21:19+00:00
URL https://domainesia.com/robots.txt
Redirect https://www.domainesia.com/robots.txt
Redirect Domain www.domainesia.com
Redirect Base domainesia.com
Domain IPs 104.26.14.183, 104.26.15.183, 172.67.70.200, 2606:4700:20::681a:eb7, 2606:4700:20::681a:fb7, 2606:4700:20::ac43:46c8
Redirect IPs 104.26.14.183, 104.26.15.183, 172.67.70.200, 2606:4700:20::681a:eb7, 2606:4700:20::681a:fb7, 2606:4700:20::ac43:46c8
Response IP 104.26.15.183
Found Yes
Hash 0d33e0372e1c3a9e5c895d995b2a5ecffe12c53e540824c0d4148daa4a56197a
SimHash 49b85bd601c1

Groups

*

Rule Path
Allow /

googlebot

Rule Path
Disallow /*?u=
Disallow /*?s=
Disallow /*?nonamp=
Disallow /feed/$
Disallow /tag/
Disallow /testimonial%26load%3Dtesti/
Disallow /composer.json
Disallow /composer.lock
Disallow /CONTRIBUTING.md
Disallow /CONTRIBUTOR_LICENSE_AGREEMENT.html
Disallow /COPYING.txt
Disallow /Gruntfile.js
Disallow /LICENSE.txt
Disallow /LICENSE_AFL.txt
Disallow /nginx.conf.sample
Disallow /package.json
Disallow /php.ini.sample
Disallow /RELEASE_NOTES.txt
Disallow /*.git
Disallow /*.zip$
Disallow /*.sql$
Disallow /*.log$
Disallow /upload-bukti
Disallow /validasi
Disallow /whodate
Disallow /whois
Back to top

Other Records

Field Value
sitemap https://www.domainesia.com/sitemap.xml
Back to top

Comments

  • Query String
  • Disable Tag & Review (Avoid duplicate content)
  • Common files
  • Disable version control folders and others
  • Disable specific url
Back to top