[sword-devel] optimizations

[Daniel Glassey]

--------------Boundary-00=_VR4I39TB2QUL9WJRZBNU
Content-Type: text/plain;
  charset="iso-8859-1"
Content-Transfer-Encoding: 8bit

On Wednesday 13 Feb 2002 11:48 pm, you wrote:
> Then I will start an
> optimization pass.  Seems we really need this as our .4 second, complete
> bible search is up to about 2.9 seconds on my 1.13GHz laptop :)  We'll
> get it back down, Lord willing.

Hi,
I've attached a file showing the main culprits in a profile of mgrtest (with 
functioncheck 1.4 www.sf.net/projects/fnccheck) with an added loop of 10 
seaches for "in the beginning" for each of 4 modules. The profiling skews 
things a bit by making calls to profiled functions relatively expensive, but 
it still looks nasty.

A large amount of time is spent applying filters in StripText - 
SWModule::filterBuffer. I don't know where to start with this but it really 
needs to be got down. Are all the optionfilters and stripfilters really 
needed or could there be just one filter that could be applied to strip the 
text?

Another thing that takes a long time is the Index function which is called on 
swmodule++	

hth,
Daniel
--------------Boundary-00=_VR4I39TB2QUL9WJRZBNU
Content-Type: text/plain;
  charset="iso-8859-1";
  name="gprmgr.tmp"
Content-Transfer-Encoding: base64
Content-Disposition: attachment; filename="gprmgr.tmp"

RmxhdCBwcm9maWxlOgoKfCAgICAgIGxvY2FsICAgICAgfCAgICAgIHRvdGFsICAgICAgfCAgICAg
ICAgICB8ICAgICAgICAgICB8CnwgICAgICBzZWMuIHwgICUgIHwgICAgICBzZWMuIHwgICUgIHwg
Y2FsbHMgICAgfHQuIHNlYy9jYWxsfCBuYW1lCnwtLS0tLS0tLS0tLXwtLS0tLXwtLS0tLS0tLS0t
LXwtLS0tLXwtLS0tLS0tLS0tfC0tLS0tLS0tLS0tfC0tLS0tLS0tCnwgICAwLjAwNTU2NXwgIDAu
MHwgMTg0LjE5MDMwNHwgOTcuOHwgICAgICAgICAxfCAxODQuMTkwMzA0fCBtYWluCnwgICA2LjUx
NDgwMXwgIDMuNXwgMTg0LjA0MTExMHwgOTcuN3wgICAgICAgIDQwfCAgIDQuNjAxMDI4fCBTV01v
ZHVsZTo6U2VhcmNoKGNoYXIgY29uc3QgKiwgaW50LCBpbnQsIFNXS2V5ICosIGJvb2wgKiwgdm9p
ZCAoKikoY2hhciwgdm9pZCAqKSwgdm9pZCAqKQp8ICAgMy43NDcxNjZ8ICAyLjB8IDExMS4yNzcw
OTd8IDU5LjF8ICAgIDk2Njk0MHwgICAwLjAwMDExNXwgU1dNb2R1bGU6OlN0cmlwVGV4dChjaGFy
ICosIGludCkKfCAgMjAuNzIxNjcyfCAxMS4wfCAgNjQuODE0ODU3fCAzNC40fCAgIDMyNDU3MDJ8
ICAgMC4wMDAwMjB8IFNXTW9kdWxlOjpmaWx0ZXJCdWZmZXIobGlzdDxTV0ZpbHRlciAqLCBhbGxv
Y2F0b3I8U1dGaWx0ZXIgKj4gPiAqLCBjaGFyICosIGxvbmcsIFNXS2V5ICopCnwgICAyLjk2MDg5
MXwgIDEuNnwgIDY0LjIxMDc4MXwgMzQuMXwgICAgOTY2OTQ0fCAgIDAuMDAwMDY2fCBTV01vZHVs
ZTo6b3BlcmF0b3IgY2hhciAqKHZvaWQpCnwgICAxLjM4NjMwOXwgIDAuN3wgIDYzLjM5Njk5MXwg
MzMuN3wgICAgOTY2OTQwfCAgIDAuMDAwMDY2fCBTV01vZHVsZTo6b3BlcmF0b3IrKyhpbnQpCnwg
ICAwLjAwMDAzOXwgIDAuMHwgIDYyLjAzNDk2NHwgMzIuOXwgICAgICAgIDEwfCAgIDYuMjAzNDk2
fCBSYXdUZXh0OjpTZWFyY2goY2hhciBjb25zdCAqLCBpbnQsIGludCwgU1dLZXkgKiwgYm9vbCAq
LCB2b2lkICgqKShjaGFyLCB2b2lkICopLCB2b2lkICopCnwgICAxLjczMDcxM3wgIDAuOXwgIDQ5
LjgyNTQyNXwgMjYuNXwgICAxMjQ0MDgwfCAgIDAuMDAwMDQwfCBTV0tleTo6b3BlcmF0b3IrPShp
bnQpCnwgICAzLjA4OTM0N3wgIDEuNnwgIDQ4LjA5NDcxMnwgMjUuNXwgICAxMjQ0MDgwfCAgIDAu
MDAwMDM5fCBWZXJzZUtleTo6aW5jcmVtZW50KGludCkKfCAgIDguMTA2MDU0fCAgNC4zfCAgNDQu
MDE5MDAwfCAyMy40fCAgIDEyOTQyODB8ICAgMC4wMDAwMzR8IFZlcnNlS2V5OjpJbmRleChsb25n
KQp8ICAgMi4wMjExMjN8ICAxLjF8ICA0MC4wNjkzODN8IDIxLjN8ICAgIDkzMzA2MHwgICAwLjAw
MDA0M3wgU1dNb2R1bGU6Om9wZXJhdG9yKz0oaW50KQp8ICAgMi4zMzEyNDZ8ICAxLjJ8ICA0MC4w
NDAxNDd8IDIxLjN8ICAgMTYyMjgzM3wgICAwLjAwMDAyNXwgU1dNb2R1bGU6Om9wdGlvbkZpbHRl
cihjaGFyICosIGxvbmcsIFNXS2V5ICopCnwgIDE3Ljk3NTAwMXwgIDkuNXwgIDMxLjAyMDk4M3wg
MTYuNXwgICAyNTg5MDk2fCAgIDAuMDAwMDEyfCBWZXJzZUtleTo6X2NvbXBhcmUoVmVyc2VLZXkg
Y29uc3QgJikKfCAgIDIuNDY2MjIyfCAgMS4zfCAgMjEuOTQxMjk5fCAxMS43fCAgICAgMzM4ODB8
ICAgMC4wMDA2NDh8IFJhd0NvbTo6b3BlcmF0b3IrPShpbnQpCnwgICAxLjQ0OTc4N3wgIDAuOHwg
IDIxLjI2MjkyNnwgMTEuM3wgICAgOTY2OTQwfCAgIDAuMDAwMDIyfCBTV01vZHVsZTo6c3RyaXBG
aWx0ZXIoY2hhciAqLCBsb25nLCBTV0tleSAqKQp8ICAgMS4wNjc4OTJ8ICAwLjZ8ICAxOS42Njg2
MTZ8IDEwLjR8ICAgIDY1NTg5M3wgICAwLjAwMDAzMHwgU1dNb2R1bGU6OlJlbmRlclRleHQoY2hh
ciAqLCBpbnQpCnwgICAzLjEyMDQyOHwgIDEuN3wgIDE4LjYwNDM0OXwgIDkuOXwgICAgMzExMDIx
fCAgIDAuMDAwMDYwfCB6VGV4dDo6Z2V0UmF3RW50cnkodm9pZCkKfCAgIDMuNDYwNDQ4fCAgMS44
fCAgMTUuNzAzMzExfCAgOC4zfCAgICAzMTEwMjF8ICAgMC4wMDAwNTB8IFJhd1RleHQ6OmdldFJh
d0VudHJ5KHZvaWQpCnwgICAwLjQxMTM3OXwgIDAuMnwgIDEyLjgwMjk3MHwgIDYuOHwgICAgMzEx
MDIwfCAgIDAuMDAwMDQxfCBTV0tleTo6b3BlcmF0b3IrKyhpbnQpCnwgICA3LjExMzA2NHwgIDMu
OHwgIDEwLjM3ODgwMHwgIDUuNXwgICA1MTExODI5fCAgIDAuMDAwMDAyfCBsaXN0PFNXRmlsdGVy
ICosIGFsbG9jYXRvcjxTV0ZpbHRlciAqPiA+OjplbmQodm9pZCkKfCAgIDUuNTUzODU5fCAgMi45
fCAgIDkuMDgwMTA5fCAgNC44fCAgIDE4NjYxMDd8ICAgMC4wMDAwMDV8IF9MaXN0X2l0ZXJhdG9y
PFNXRmlsdGVyICosIFNXRmlsdGVyIComLCBTV0ZpbHRlciAqKj46Om9wZXJhdG9yKysoaW50KQp8
ICAgMC44NzM2OTd8ICAwLjV8ICAgOC4xNjY0NjZ8ICA0LjN8ICAgIDY1NTkyM3wgICAwLjAwMDAx
MnwgU1dNb2R1bGU6OnJhd0ZpbHRlcihjaGFyICosIGxvbmcsIFNXS2V5ICopCnwgICA3Ljg2Nzcx
NHwgIDQuMnwgICA3Ljg2NzcxNHwgIDQuMnwgICAxMjQ0MDUyfCAgIDAuMDAwMDA2fCBHQkZGb290
bm90ZXM6OlByb2Nlc3NUZXh0KGNoYXIgKiwgaW50LCBTV0tleSBjb25zdCAqLCBTV01vZHVsZSBj
b25zdCAqKQp8ICAgNS43NDY2ODV8ICAzLjF8ICAgNy43ODE4OTN8ICA0LjF8ICAgMTAwMDgxM3wg
ICAwLjAwMDAwOHwgUmF3VmVyc2U6OmZpbmRvZmZzZXQoY2hhciwgbG9uZywgbG9uZyAqLCB1bnNp
Z25lZCBzaG9ydCAqKQp8ICAgNC43NzMzNzV8ICAyLjV8ICAgNi44OTM2NDh8ICAzLjd8ICAgMzI0
NTcwM3wgICAwLjAwMDAwMnwgbGlzdDxTV0ZpbHRlciAqLCBhbGxvY2F0b3I8U1dGaWx0ZXIgKj4g
Pjo6YmVnaW4odm9pZCkKfCAgIDMuNzE2NjM1fCAgMi4wfCAgIDYuNzgyNzE3fCAgMy42fCAgICAz
MTEwMjF8ICAgMC4wMDAwMjJ8IHpWZXJzZTo6ZmluZG9mZnNldChjaGFyLCBsb25nLCBsb25nICos
IHVuc2lnbmVkIHNob3J0ICopCnwgICA1LjM4NjAyM3wgIDIuOXwgICA1LjM4NjAyM3wgIDIuOXwg
ICA4MzU3NTUxfCAgIDAuMDAwMDAxfCBfTGlzdF9pdGVyYXRvcjxTV0ZpbHRlciAqLCBTV0ZpbHRl
ciAqJiwgU1dGaWx0ZXIgKio+OjpfTGlzdF9pdGVyYXRvcihfTGlzdF9ub2RlPFNXRmlsdGVyICo+
ICopCnwgICA0LjUzNDM3M3wgIDIuNHwgICA0LjUzNDM3M3wgIDIuNHwgICA3MTQ2MDI5fCAgIDAu
MDAwMDAxfCBWZXJzZUtleTo6VGVzdGFtZW50KHZvaWQpIGNvbnN0CnwgICAxLjcwNjk1OXwgIDAu
OXwgICAzLjc4OTI4NnwgIDIuMHwgICAgMzExMDIxfCAgIDAuMDAwMDEyfCBSYXdGaWxlczo6Z2V0
UmF3RW50cnkodm9pZCkKfCAgIDMuNzA1MTU2fCAgMi4wfCAgIDMuNzA1ODIxfCAgMi4wfCAgIDU2
NjM5Nzl8ICAgMC4wMDAwMDF8IEZpbGVEZXNjOjpnZXRGZCh2b2lkKQp8ICAgMy40NzIwNTF8ICAx
Ljh8ICAgMy40NzIwNTF8ICAxLjh8ICAgIDYyMjA0MHwgICAwLjAwMDAwNnwgR0JGUGxhaW46OlBy
b2Nlc3NUZXh0KGNoYXIgKiwgaW50LCBTV0tleSBjb25zdCAqLCBTV01vZHVsZSBjb25zdCAqKQp8
ICAgMy40MjU0OTB8ICAxLjh8ICAgMy40MjU0OTB8ICAxLjh8ICAgNDg2NzI5NHwgICAwLjAwMDAw
MXwgVmVyc2VLZXk6OkluZGV4KHZvaWQpIGNvbnN0CnwgICAzLjI5ODU0MnwgIDEuOHwgICAzLjI5
ODU0MnwgIDEuOHwgICA1MTc4MjcyfCAgIDAuMDAwMDAxfCBWZXJzZUtleTo6VmVyc2Uodm9pZCkg
Y29uc3QKfCAgIDMuMjY5MTEwfCAgMS43fCAgIDMuMjY5MTEwfCAgMS43fCAgIDUxNzgyNzJ8ICAg
MC4wMDAwMDF8IFZlcnNlS2V5OjpCb29rKHZvaWQpIGNvbnN0CnwgICAzLjIxNTMxOXwgIDEuN3wg
ICAzLjIxNTMxOXwgIDEuN3wgICA1MTc4MzU2fCAgIDAuMDAwMDAxfCBWZXJzZUtleTo6Q2hhcHRl
cih2b2lkKSBjb25zdAp8ICAgMS45NzgxOTN8ICAxLjF8ICAgMy4xMjc5ODR8ICAxLjd8ICAgMTMx
MTg4NHwgICAwLjAwMDAwMnwgU1dDbGFzczo6aXNBc3NpZ25hYmxlRnJvbShjaGFyIGNvbnN0ICop
IGNvbnN0CnwgICAzLjEyNDk5NnwgIDEuN3wgICAzLjEyNDk5NnwgIDEuN3wgICA1MTExODEwfCAg
IDAuMDAwMDAxfCBfTGlzdF9pdGVyYXRvcjxTV0ZpbHRlciAqLCBTV0ZpbHRlciAqJiwgU1dGaWx0
ZXIgKio+OjpvcGVyYXRvciE9KF9MaXN0X2l0ZXJhdG9yPFNXRmlsdGVyICosIFNXRmlsdGVyICom
LCBTV0ZpbHRlciAqKj4gY29uc3QgJikgY29uc3QKfCAgIDIuMzIyNTAwfCAgMS4yfCAgIDIuOTc2
OTg1fCAgMS42fCAgICAzNDQ5MDJ8ICAgMC4wMDAwMDl8IFJhd1ZlcnNlOjpnZXR0ZXh0KGNoYXIs
IGxvbmcsIHVuc2lnbmVkIHNob3J0LCBjaGFyICopCnwgICAwLjQ2OTc2NXwgIDAuMnwgICAyLjg0
OTAxOXwgIDEuNXwgICAgIDMzODgxfCAgIDAuMDAwMDg0fCBSYXdDb206OmdldFJhd0VudHJ5KHZv
aWQpCnwgICAyLjMxNjI4M3wgIDEuMnwgICAyLjMxNjI4M3wgIDEuMnwgICAgMzQ0OTAyfCAgIDAu
MDAwMDA3fCBSYXdWZXJzZTo6cHJlcHRleHQoY2hhciAqKQp8ICAgMi4zMTMzNTh8ICAxLjJ8ICAg
Mi4zMTMzNTh8ICAxLjJ8ICAgMzczMjIxNHwgICAwLjAwMDAwMXwgX0xpc3RfaXRlcmF0b3I8U1dG
aWx0ZXIgKiwgU1dGaWx0ZXIgKiYsIFNXRmlsdGVyICoqPjo6X0xpc3RfaXRlcmF0b3IoX0xpc3Rf
aXRlcmF0b3I8U1dGaWx0ZXIgKiwgU1dGaWx0ZXIgKiYsIFNXRmlsdGVyICoqPiBjb25zdCAmKQp8
ICAgMC4wMDAwOTR8ICAwLjB8ICAgMi4zMDk1Nzh8ICAxLjJ8ICAgICAgICAyMnwgICAwLjEwNDk4
MXwgU1dDb25maWc6OlNXQ29uZmlnKGNoYXIgY29uc3QgKikKfCAgIDAuMDMzODQ4fCAgMC4wfCAg
IDIuMzA3OTg4fCAgMS4yfCAgICAgICAgMjJ8ICAgMC4xMDQ5MDl8IFNXQ29uZmlnOjpMb2FkKHZv
aWQpCnwgICAyLjI3Mzc0MHwgIDEuMnwgICAyLjI3Mzc0MHwgIDEuMnwgICAyNTg4NTYwfCAgIDAu
MDAwMDAxfCBWZXJzZUtleTo6ZmluZGluZGV4KGxvbmcgKiwgaW50LCBsb25nKQp8ICAgMC4wMDAw
MDN8ICAwLjB8ICAgMi4yNjA0NzJ8ICAxLjJ8ICAgICAgICAgMXwgICAyLjI2MDQ3MnwgZ2xvYmFs
IGNvbnN0cnVjdG9ycyBrZXllZCB0byBMb2NhbGVNZ3I6OkxvY2FsZU1ncihjaGFyIGNvbnN0ICop
CnwgICAwLjAwMDAwOXwgIDAuMHwgICAyLjI2MDQ2OXwgIDEuMnwgICAgICAgICAxfCAgIDIuMjYw
NDY5fCBfX3N0YXRpY19pbml0aWFsaXphdGlvbl9hbmRfZGVzdHJ1Y3Rpb25fMAp8ICAgMC4wMDAw
MzJ8ICAwLjB8ICAgMi4yNjA0NjB8ICAxLjJ8ICAgICAgICAgMXwgICAyLjI2MDQ2MHwgTG9jYWxl
TWdyOjpMb2NhbGVNZ3IoY2hhciBjb25zdCAqKQp8ICAgMC4wMDAzMjF8ICAwLjB8ICAgMi4yNTgw
NDF8ICAxLjJ8ICAgICAgICAgMXwgICAyLjI1ODA0MXwgTG9jYWxlTWdyOjpsb2FkQ29uZmlnRGly
KGNoYXIgY29uc3QgKikKfCAgIDAuMDAwMjM3fCAgMC4wfCAgIDIuMjU0MDY1fCAgMS4yfCAgICAg
ICAgIDh8ICAgMC4yODE3NTh8IFNXTG9jYWxlOjpTV0xvY2FsZShjaGFyIGNvbnN0ICopCnwgICAy
LjExNDQ0NHwgIDEuMXwgICAyLjExNDQ0NHwgIDEuMXwgICAzMjQ1NzAyfCAgIDAuMDAwMDAxfCBf
TGlzdF9pdGVyYXRvcjxTV0ZpbHRlciAqLCBTV0ZpbHRlciAqJiwgU1dGaWx0ZXIgKio+OjpfTGlz
dF9pdGVyYXRvcih2b2lkKQp8ICAgMS40MjE5OTN8ICAwLjh8ICAgMi4wODIyMzl8ICAxLjF8ICAg
IDk2Njk0MHwgICAwLjAwMDAwMnwgVmVyc2VLZXk6Ok5ld0luZGV4KHZvaWQpIGNvbnN0CnwgICAw
LjAwMjkyOHwgIDAuMHwgICAyLjAwMzI2NXwgIDEuMXwgICAgICAxMzIyfCAgIDAuMDAxNTE1fCBT
V0NvbXByZXNzOjpCdWYoY2hhciBjb25zdCAqLCB1bnNpZ25lZCBsb25nICopCnwgICAxLjY5MjEx
N3wgIDAuOXwgICAyLjAwMDMzN3wgIDEuMXwgICAgICAgNjYxfCAgIDAuMDAzMDI2fCBaaXBDb21w
cmVzczo6RGVjb2RlKHZvaWQpCnwgICAxLjk0MTIxNHwgIDEuMHwgICAxLjk0MTIxNHwgIDEuMHwg
ICAgMzExMDIxfCAgIDAuMDAwMDA2fCB6VmVyc2U6OnByZXB0ZXh0KGNoYXIgKikKfCAgIDAuNjgx
Njg4fCAgMC40fCAgIDEuMjYxMjE5fCAgMC43fCAgICAzMTIyMDJ8ICAgMC4wMDAwMDR8IFNXS2V5
OjpTV0tleShTV0tleSBjb25zdCAmKQp8ICAgMS4yMTI4OTJ8ICAwLjZ8ICAgMS4yMTI4OTJ8ICAw
LjZ8ICAgMTg2NjEwN3wgICAwLjAwMDAwMXwgX0xpc3RfaXRlcmF0b3I8U1dGaWx0ZXIgKiwgU1dG
aWx0ZXIgKiYsIFNXRmlsdGVyICoqPjo6b3BlcmF0b3IrKyh2b2lkKQp8ICAgMS4xNjE1NzN8ICAw
LjZ8ICAgMS4xNjE1NzN8ICAwLjZ8ICAgMTg2NjEwN3wgICAwLjAwMDAwMXwgX0xpc3RfaXRlcmF0
b3I8U1dGaWx0ZXIgKiwgU1dGaWx0ZXIgKiYsIFNXRmlsdGVyICoqPjo6b3BlcmF0b3IqKHZvaWQp
IGNvbnN0CnwgICAxLjE1MDExM3wgIDAuNnwgICAxLjE1MDExM3wgIDAuNnwgICAxMzEyMzU0fCAg
IDAuMDAwMDAxfCBzdHJpY21wKGNoYXIgY29uc3QgKiwgY2hhciBjb25zdCAqKQ==

--------------Boundary-00=_VR4I39TB2QUL9WJRZBNU--

_________________________________________________________
Do You Yahoo!?
Get your free @yahoo.com address at http://mail.yahoo.com