Richard Purdie fd00566144 bitbake/codeparser: Improve cache handling ...

The current codeparser cache handling hurts performance badly even
over a couple of cores and certainly on many core systems, it can
spent huge amounts of time in the codeparser cache save functions.

This patch reworks the cache handling so that each parsing thread
saves out its own "differences" file compared to any existing core
cache and then the main bitbake thread picks these up and merges
things back together.

This was tested on systems with small and large numbers of cores
and was found to perform orders of magnitude better in all cases
despite the more complex code.

(Bitbake rev: 9f27563d66523f5af1028f173d53ee75e0877d46)

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>

2011-05-27 17:55:51 +01:00

..

fetch

bitbake: Sync fetch back with upstream

2011-05-06 18:18:59 +01:00

fetch2

fetch2/git: enhance the unpack by using "git checkout"

2011-05-27 17:55:50 +01:00

parse

bitbake/ast.py: Only run finalise() for the specified variant

2011-05-05 15:52:36 +01:00

pysh

bitbake: Sync a load of whitespace and other non-functionality changes with bitbake uptream

2011-01-04 14:46:54 +00:00

server

bitbake/xmlrpc: only use BBTransport for affected Python versions

2011-03-14 20:48:37 +00:00

ui

bitbake/ui: Fix Gtk+ GUI's after recent cache changes

2011-05-16 20:48:34 +01:00

__init__.py

bitbake:__init__.py: Fix debug log level handling to correct debug output

2011-02-07 14:50:27 +00:00

build.py

build/siggen: Ensure a task signature file is generated for each task that is executed

2011-05-25 23:39:37 +01:00

cache.py

bitbake/cache.py: Ensure skipped recipes make it into the cache to avoid reparsing

2011-05-05 15:53:09 +01:00

codeparser.py

bitbake/codeparser: Improve cache handling

2011-05-27 17:55:51 +01:00

command.py

bitbake: implement command to find configuration files for a config variable

2011-02-24 15:54:51 +00:00

compat.py

bitbake: Add missing file

2011-05-07 08:49:28 +01:00

cooker.py

bitbake/codeparser: Improve cache handling

2011-05-27 17:55:51 +01:00

COW.py

Apply some 2to3 refactorings

2010-07-02 15:41:37 +01:00

daemonize.py

Apply some 2to3 transforms that don't cause issues in 2.6

2010-07-02 15:41:33 +01:00

data_smart.py

More 'is' fixups

2011-03-31 12:23:24 +01:00

data.py

bitbake/siggen.py: Fix whitelisted variable handling

2011-01-12 15:58:48 +00:00

event.py

event: improve output for syntax errors in handlers

2011-05-06 15:48:34 +01:00

methodpool.py

Consolidate the exec/eval bits, switch anonfunc to better_exec, etc

2010-07-02 15:41:31 +01:00

msg.py

Enable some DeprecationWarnings

2011-05-06 18:24:13 +01:00

persist_data.py

bitbake/persist_data: Sync file with upstream bitbake

2011-05-06 18:07:23 +01:00

process.py

process.py: Avoid deprecation warning

2011-02-14 16:32:07 +00:00

providers.py

bitbake/providers.py: Fix runtime providers problems

2011-01-20 22:44:33 +00:00

runqueue.py

bitbake/runqueue.py: Ensure existing setscene stamp files are taken into account

2011-05-27 17:55:51 +01:00

shell.py

cooker: stop loading the cache for -b

2011-01-04 14:46:43 +00:00

siggen.py

build/siggen: Ensure a task signature file is generated for each task that is executed

2011-05-25 23:39:37 +01:00

taskdata.py

cooker: use re match, not search in re_match_strings

2011-01-04 14:46:47 +00:00

utils.py

bitbake/utils.py: Add option to lockfiles to return immediately rather than wait

2011-05-27 17:55:51 +01:00