CoreCommunity ExtensionsIncubatorDistributionsTYPO3 4.5 ProjectsTYPO3 4.7 ProjectsTYPO3 6.0 ProjectsTYPO3 6.1 ProjectsTYPO3 6.2 Projects (+)

Bug #9012

ERROR: Directory "mypage" was still not created with crawler 3.2.0 and typo3 4.4

Added by Riccardo De Contardi almost 3 years ago. Updated 10 months ago.

Status:Resolved Start date:2010-07-24
Priority:Must have Due date:
Assignee:Michael Klapper % Done:

0%

Category:-
Target version:-
Votes: 0

Description

I've stumbled upon a few problems with Typo3 4.4 and crawler/staticpub

Here is my full list of installed extensions:
kickstarter 0.4.0
crawler 3.2.0
staticpub 1.1.0
chgallery 2.5.1
css_filelinks 0.2.18
realurl 1.9.3
tt_address 2.2.1
rzcolorbox 1.2.0
sr_language_menu 1.5.2
rt_pageteaser 1.6.1
static_info_tables 2.1.2
t3jquery 1.6.1
templavoila 1.5.0

Please take note that this is a FRESH installation, not an upgrade.

- I've added the line

$GLOBALS['TYPO3_CONF_VARS']['EXTCONF']['staticpub']['publishDir'] = '_staticpub_/';

in localconf.php

- the folder staticpub has the correct permissions (read/write)

My crawler config in Page TSConfig is:

tx_crawler.crawlerCfg.paramSets {
staticpub = &L=[|_TABLE:pages_language_overlay;_FIELD:sys_language_uid]
staticpub.procInstrFilter = tx_staticpub_publish
staticpub.baseUrl = http://typo3.test.44l/
}

When I manually start the crawler via the info module, it seems that everything goes right ("Process completed successfully" message) , but..

1. Nothing is published
2. In the log every page has this error:

"ERROR: ERROR: Directory "pagina-1" was still not created!"

except the home page:

"EXT:static_pub; OK: "/" published in "_staticpub_/". Msg: Existing file updated"

Which is false, as there is no published file in staticpub

With Crawler 3.1.2 everything goes fine

History

Updated by Michael Klapper 10 months ago

  • Status changed from New to Needs Feedback

Is this still relevant?

Updated by Riccardo De Contardi 10 months ago

I'm trying to update the bug but I have some problems...

1. I'm using now TYPO3 version 4.5.19
2. I followed the manual for crawler 3.2.0 http://typo3.org/extension-manuals/crawler/3.2.0/view/toc/0/, including the creation of a configuration record, instead of putting the configuration in TS config ;)
3. I created the _cli_crawler user
4. crawling url manually via the web>info module does not work : log shows "no entries" in "Queue id:" column for all urls, but no further messages explaining what goes wrong :( Am I forgetting something??

5. According to the crawler manual, http://typo3.org/extension-manuals/crawler/3.2.0/view/1/6/ left-clicking on the crawler configuration (list view) pops up the context menu with a new voice (Crawl)...true, but... clicking on it leads to an error:

Not Found
The requested URL /typo3/mod/web/info/index.php was not found on this server.

actually, /typo3/mod/web/ has no /info/ subdirectory :S

thank you for your patience and best regards

================= UPDATE =================

About point 4.: obviously I was forgetting someting!! I did not click onConfigurations:publish (silly me!), but now... the result is even worse: selecting "publish" and then clicking on any of the three buttons below (update, Crawl Urls, Download Urls), the result is... an empty backend page...

Apache error log when clicking on "update":

[Tue Aug 21 10:09:42 2012] [error] [client 192.168.182.1] PHP Fatal error:  Call to protected method tx_realurl::setConfig() from context 'tx_crawler_lib' in /var/lib/typo3-sites/dummy-4.5L_bhuman/typo3conf/ext/crawler/class.tx_crawler_lib.php on line 272, referer: http://typo3.bhuman.dev.it/typo3/sysext/info/mod1/index.php?id=1&

Apache error log when clicking on "Crawl Urls":
[Tue Aug 21 10:11:00 2012] [error] [client 192.168.182.1] PHP Fatal error:  Call to protected method tx_realurl::setConfig() from context 'tx_crawler_lib' in /var/lib/typo3-sites/dummy-4.5L_bhuman/typo3conf/ext/crawler/class.tx_crawler_lib.php on line 272, referer: http://typo3.bhuman.dev.it/typo3/sysext/info/mod1/index.php?id=1&

Apache error log when clicking on "Download Urls"
[Tue Aug 21 10:11:48 2012] [error] [client 192.168.182.1] PHP Fatal error:  Call to protected method tx_realurl::setConfig() from context 'tx_crawler_lib' in /var/lib/typo3-sites/dummy-4.5L_bhuman/typo3conf/ext/crawler/class.tx_crawler_lib.php on line 272, referer: http://typo3.bhuman.dev.it/typo3/sysext/info/mod1/index.php?id=1

Updated by Michael Klapper 10 months ago

2. I followed the manual for crawler 3.2.0 http://typo3.org/extension-manuals/crawler/3.2.0/view/toc/0/, including the creation of a configuration record, instead of putting the configuration in TS config ;)

You have two options here, just use the TSconfig as described in your initial issue report (tsconfig should be still supported by the extension). Otherwise you can compare the attached screen "21-08-2012 14-56-26.png" to see how you can create the records.

Regarding your UPDATE section, i asume you checked the "Use realurl urls" checkox right? Unfortunately this function is not supported any more due to some major realurl extension refactorings and the checkbox is also already removed from the confgiuration record for the next crawler release.
So just uncheck that option an try again please.

Updated by Riccardo De Contardi 10 months ago

Thank you for your answer :)
The "Use realurl urls" checkbox did the trick: now the interface works...
I don't see attached files, but this is my configuration:
Name:

publish

Processing instruction filter:

 Publish static [tx_staticpub_publish]

Configuration:

&L=[|_TABLE:pages_language_overlay;_FIELD:sys_language_uid]

BaseUrl:

http://typo3.bhuman.dev.it/

Pids only: nothing

Processing instruction parameters:none

All the remaining config: empty

and now... it works!! GREAT!!

By the way:
1. if in the configuration I set Crawl workspace=LIVE with the dropdown, this value is not saved
2. (really, really minor) : In the "Processing instruction filter: " field, there is a red "?" icon... it is quite misleading (it seems there is a problem)... actually, the element has this class:

t3-icon t3-icon-status t3-icon-status-status t3-icon-status-icon-missing

So I think there is a small bug about the icon

Thank you for your patience and dedication and best regards

Updated by Michael Klapper 10 months ago

1. if in the configuration I set Crawl workspace=LIVE with the dropdown, this value is not saved

The live worspace is used as default value, however I fixed the problem selecting the live workspace value as well (will be part of next crawler release ~ 3-4 weeks).

Updated by Michael Klapper 10 months ago

2. (really, really minor) : In the "Processing instruction filter: " field, there is a red "?" icon... it is quite misleading (it seems there is a problem)... actually, the element has this class:

This comes from the TYPO3 core form rendering, so unfortunately this cannot be fixed in the crawler extension :)

BTW; I asume that this ticket can be set to resolved, right?

Updated by Michael Klapper 10 months ago

2. (really, really minor) : In the "Processing instruction filter: " field, there is a red "?" icon... it is quite misleading (it seems there is a problem)... actually, the element has this class:

Just found out that this can be solved in crawler...
http://forge.typo3.org/issues/40051

Updated by Michael Klapper 10 months ago

  • Status changed from Needs Feedback to Resolved
  • Assignee set to Michael Klapper

Also available in: Atom PDF