mirror of
https://github.com/fmhy/edit.git
synced 2025-10-13 08:11:07 +11:00
49f816991d
* update robots.txt disallow crawlers from /assets/ they treat it as junk/bad content * Update robots.txt make it so image files in the base directory don't get indexed
6 lines
96 B
Text
6 lines
96 B
Text
User-agent: *
|
|
Disallow: /assets/
|
|
Disallow: /*.png$
|
|
Disallow: /*.svg$
|
|
Disallow: /*.ico$
|
|
Allow: /
|