]> code.ossystems Code Review - openembedded-core.git/commit
package: Add cachedpath optimisation
authorRichard Purdie <richard.purdie@linuxfoundation.org>
Thu, 14 Mar 2013 17:26:20 +0000 (17:26 +0000)
committerRichard Purdie <richard.purdie@linuxfoundation.org>
Mon, 18 Mar 2013 21:26:06 +0000 (21:26 +0000)
commit556dee0c4d6d8a87c0cddbd2f60fe5917d009f18
tree0392d47555698777c94dda9a02fe1208e192f06d
parente0705e4801a9855a4289d18e653c35190021206e
package: Add cachedpath optimisation

Currently, various standard library operations like os.walk(),
os.path.isdir() and os.path.islink() each call stat or lstat which
involves a syscall into the kernel. There is no caching since they could
conceivably have changed on disk. The result is that for something like
the do_package task of the kernel we're spending over two minutes making
868,000 individual stat calls for 23,000 files. This is suboptimal.

This patch adds lib/oe/cachedpath.py which are a set of replacement
functions for these operations which use cached stat data rather than
hitting the kernel each time. It gives a nice performance improvement
halving the build time of the kernel do_package.

Signed-off-by: Richard Purdie <richard.purdie@linuxfoundation.org>
meta/classes/base.bbclass
meta/classes/package.bbclass
meta/lib/oe/cachedpath.py [new file with mode: 0644]