Project

General

Profile

Actions

Bug #18599

closed

Table table index_rel: don't write stopwords into

Added by Marco Peemoeller about 16 years ago. Updated over 5 years ago.

Status:
Closed
Priority:
Should have
Assignee:
-
Category:
Indexed Search
Target version:
-
Start date:
2008-04-10
Due date:
% Done:

100%

Estimated time:
TYPO3 Version:
4.1
PHP Version:
Tags:
Complexity:
Is Regression:
No
Sprint Focus:

Description

The table index_rel can grows to enormous size and the performance of searchqueries slow down. I think it is not necessary to write stopwords into the table.

function submitWords($wl,$phash) {
$stopwords = array();
$res = $GLOBALS['TYPO3_DB']->exec_SELECTquery('wid', 'index_words', 'is_stopword != 0');
while($row = $GLOBALS['TYPO3_DB']->sql_fetch_assoc($res)) {
$stopwords[$row['wid']] = 1;
}

$GLOBALS['TYPO3_DB']->exec_DELETEquery('index_rel', 'phash='.intval($phash));
foreach($wl as $val)    {
if(isset($stopwords[$val['hash']])) {
continue;
}
$insertFields = array(
'phash' => $phash,
'wid' => $val['hash'],
'count' => $val['count'],
'first' => $val['first'],
'freq' => $this->freqMap(($val['count']/$this->wordcount)),
'flags' => ($val['cmp'] & $this->flagBitMask)
);
$GLOBALS['TYPO3_DB']->exec_INSERTquery('index_rel', $insertFields);
}
}
(issue imported from #M8083)

Related issues 1 (0 open1 closed)

Related to TYPO3 Core - Feature #38742: indexed_search performance: function submitWords with exec_INSERTmultipleRowsClosed2012-06-19

Actions
Actions #1

Updated by Alexander Opitz about 11 years ago

  • Status changed from New to Needs Feedback
  • Target version deleted (0)
  • TYPO3 Version set to 4.1

As this report is very old, is the handling in newer TYPO3 CMS Versions (like 6.0/6.1) more like you expect it?

Actions #2

Updated by Alexander Opitz almost 11 years ago

  • Status changed from Needs Feedback to Closed
  • Is Regression set to No

No feedback for over 90 days.

Actions #3

Updated by Tymoteusz Motylewski almost 10 years ago

unfortunatelly this is still an issue.
TYPO3\CMS\IndexedSearch\Indexer is writing stopwords into the index_rel table...
This is quite a performance issue.

Actions #4

Updated by Gerrit Code Review almost 10 years ago

  • Status changed from Closed to Under Review

Patch set 6 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/20275

Actions #5

Updated by Gerrit Code Review almost 10 years ago

Patch set 7 for branch master of project Packages/TYPO3.CMS has been pushed to the review server.
It is available at http://review.typo3.org/20275

Actions #6

Updated by Anonymous over 9 years ago

  • Status changed from Under Review to Resolved
  • % Done changed from 0 to 100
Actions #7

Updated by Benni Mack over 5 years ago

  • Status changed from Resolved to Closed
Actions

Also available in: Atom PDF