Robots.txt Tester

Inspect how creativeengineeringbd.com controls crawler access, blocked paths, sitemap references and AI crawler rules.

Robots.txt Status Present Score 84 /100 · Strong

Domain creativeengineeringbd.com

robots.txt URL https://creativeengineeringbd.com/robots.txt

Last analyzed May 10, 2026

View Full Robots.txt

Open robots.txt in a new tab

Download robots.txt

Robots.txt Content Preview

User-agent: *
Disallow: /wp-content/uploads/wc-logs/
Disallow: /wp-content/uploads/woocommerce_transient_files/
Disallow: /wp-content/uploads/woocommerce_uploads/
Disallow: /*?add-to-cart=
Disallow: /*?*add-to-cart=
Disallow: /wp-admin/
Allow: /wp-admin/admin-ajax.php

Sitemap: https://www.creativeengineeringbd.com/wp-sitemap.xml

User-agent Rules

User-agent(s)	Allowed paths	Disallowed paths
*	/wp-admin/admin-ajax.php	/wp-content/uploads/wc-logs/ /wp-content/uploads/woocommerce_transient_files/ /wp-content/uploads/woocommerce_uploads/ /?add-to-cart= /?*add-to-cart= /wp-admin/

Blocked and Allowed Paths

Blocked paths	/wp-content/uploads/wc-logs/ /wp-content/uploads/woocommerce_transient_files/ /wp-content/uploads/woocommerce_uploads/ /?add-to-cart= /?*add-to-cart= /wp-admin/
Allowed paths	/wp-admin/admin-ajax.php
Crawl-delay	No Crawl-delay directive detected.

Sitemaps Detected

https://www.creativeengineeringbd.com/wp-sitemap.xml

AI Crawler Policy

No explicit blocks were detected for common AI crawlers (GPTBot, ChatGPT-User, ClaudeBot, PerplexityBot, Google-Extended).

Issues Found

Sitemap URL appears to be unreachable: https://www.creativeengineeringbd.com/wp-sitemap.xml
Blocking CSS or JS may prevent search engines from rendering pages correctly.

Recommendations

Document your AI crawler policy explicitly in robots.txt so future bots know how to treat your content.
Ensure important pages, CSS and JavaScript assets are crawlable so search engines can fully render your site.