View Issue Details

IDProjectCategoryView StatusLast Update
0003241OXID eShop (all versions)4.09. SEO, SEO URLpublic2012-12-10 13:34
Reportertjungcl Assigned To 
PrioritynormalSeverityminorReproducibilityalways
Status resolvedResolutionfixed 
Product Version4.5.2 revision 38481 
Fixed in Version4.5.3 revision 39087 
Summary0003241: robot detection quite imprecise
Descriptionthe list of keywords that are used to detect robots is
googlebot
ultraseek
crawl
spider
fireball
robot
spider
robot
slurp
fast
altavista
teoma

Several of the most common bots stay undetected with this list, for example msnbot, bingbot or yandex.

Additionally you have the entries robot and splider twice in that list.

TagsNo tags attached.
ThemeBoth
BrowserAll
PHP Versionany
Database Versionany

Activities

svetlana

2011-09-15 15:01

reporter   ~0005223

We will add bots to our list, but they will have influence when parameter blForceSessionStart is seted to true.

tjungcl

2011-09-15 15:23

reporter   ~0005226

what do you mean? what kind of influence? why is the list of knows robots affecting session start?

arvydas_vapsva

2011-09-20 13:14

reporter   ~0005247

Last edited: 2011-09-20 13:21

actually we plan to remove search engine (SE) check at all, because:
- new SE bots appears and we cant always be up-to-date (latest bot list containts > 300 items..);
- major SE does not like if we deliver different content for different user agents;
- many links which should not be accessed by SE allready has rel="nofollow" attribute.

so for current phase i will append existing list with few most popular bots

arvydas_vapsva

2011-09-20 13:18

reporter   ~0005248

Last edited: 2011-09-20 13:20

now session is only started on special actions + if user agent is not in robot list. exeptionally session automatically is started in special case if config parameter "blForceSessionStart" is TRUE.

in next major release we plan to refactor session handling so, that session is started only when some session data is set, not on some specific cases like it is now