INN Patches: Performance
NOTE: In addition to items listed here, the News Utilities pages may be of interest
cancel.151.patch is the same as cancel.14u4.patch, just for 1.5.1. Read the notes or be sorry.
(At Joe Greco's INN Patch Shop)
"...a patch that alters the spool format used by INN to store "control/cancel"... This will speed up cancel reception of lots of cancels by orders of magnitude, because one of the biggest bottlenecks is repeatedly searching a directory that is several hundred kilobytes (or even a few megabytes) long. Read the notes or be sorry....."
Can apply to: INN 1.5.1, inn1.5.1corr/1.7. Fails against INN 1.6b3.
[See also: prune.tgz at the same site for a different solution.]
innd-timer-14u4.tgz (At Joe Greco's INN Patch Shop)
Also: innd-timer-151.tgz
"..is a combination patch and new files that will provide profiling information about where your innd is spending its time. I will write a notes page sometime, I hope, as the output is a bit cryptic."
innd-timer.shar.gz (At BELNET)
"a patch to innd (1.4unoff4) which adds reporting of statistics of how much time innd is spending
waiting (idle), as well as numbers of other events. Good for comparing news servers and seeing
how overloaded yours is.
actived.tgz (At Joe Greco's INN Patch Shop)
(For INN1.4unoff4 but will work directly on INN 1.5.1 without changes. Andrew Smith at insync.net "cleaned" it up, with the support of Joe, to make it more portable to other O/S's. http://www.insync.net/~aos/actived/actived.tar.gz)
"is IMHO the most cool hack I've done. It's a replacement for all the sharedactive/mmap-active stuff that approaches the problem from a different angle: it uses an active file _server_ process. It has many benefits, including allowing incredibly high numbers of nnrpd session spawnoffs without a significant CPU impact. It also stops ps/top/etc from lying about memory consumption, one of my various sharedactive gripes... and unlike sharedactive, it _can_ _not_ hang all your nnrpd processes if the sharing strategy develops a problem."
his.lookup.cache.diff (At Erols.com)
"This adds a relatively large history lookup cache into the HIShavearticle function. It caches both positive and negative responses. The cache size is by default 64k message-id's, organized in a hash table. Hash table collisions are handled by just replacing the entry. This is a relatively naive implementation, but I've been getting over 80% hit rates with it with 150-200 incoming connections. Several people have reported that this makes a lot of difference in cpu utilization."
This patch has a memory leak, described by Gary Palmer 1997/06/30 Memory leak in Clayton O'neill's HIScache patches But in order to prevent duplicate entries which will corrupt the history file, it is necessary to purge the cache when the history file is reloaded. This is especially important anytime inn is paused and the history file is changed externally. hiscacheleak.diff
innd.postcount.fix.diff (At Erols.com)
"This fixes a problem in how innd handles aliased groups with crossposts.....Profiling here indicates that this was eating about 20-30% of the time innd uses. This patch changes the behavior to only clear the flag in the groups that we actually marked, after we've done the check."
Applying to INN 1.5.1
ftp://ftp.isc.org/isc/inn/unoff-patches/art.c-misc-changes.patch
6 Kb Mon Mar 31 20:35:00 1997
Type: Nuisance fix, performance
Symptom: Cancelled articles causing "437 Duplicate article" log entries and
history records
Applies to:INN-1.5.1/innd/art.c
OS: all
Incorporated into stock 1.5.1: No
Incorporated into stock 1.5.1sec2: No
Incorporated into stock inn1.5.1corr/1.7: Yes. See note below.
Incorporated into stock 1.6b3: Yes. See note below.
Note: This patch is not applied verbatim in 1.5.1corr and 1.6b3, but the code is fixed.
One optimization of if() condition order is not in 1.5.1corr nor 1.6b3.
Authored: J. Porter Clark, 31 Mar 1997
ftp://ftp.isc.org/isc/inn/unoff-patches/fast-renumber.patch
7 Kb Wed Mar 26 15:10:00 1997
Type: Performance (Renumber delay)
Symptom: innd does nothing else when renumbering. This allows a separate
process to do the work and report the result to innd.
Applies to: INN-1.5.1 various
OS: all
Incorporated into stock 1.5.1: No
Incorporated into stock 1.5.1sec2: No
Incorporated into stock inn1.5.1corr/1.7: No. It does not fix a defect.
Incorporated into stock 1.6b3: Yes, but not verbatim.
Authored: Jerry Aguirre, 14 Mar 1997
ftp://ftp.isc.org/isc/inn/unoff-patches/1.5.1/inn-patch-apb-19970129
52 Kb Thu Feb 27 18:58:00 1997
Type: Multiple, Performance
Symptom: Substantial changes to make innd more responsive to connections,
and various others.
Features in the patch. Worker function, Work limits, background renumber,
Defect fixes in the patch: NCwritetext() caller's, RCHANadd() buffer zapping, subst.1 manpage (minor)
Author's preferences in the patch: innxmit logRejects, config updates to samples,
Applies to: INN-1.5.1 various
OS: all
Incorporated into stock 1.5.1: No
Incorporated into stock 1.5.1sec2: No
Incorporated into stock inn1.5.1corr/1.7: partial. Defect fixes only.
Incorporated into stock 1.6b3: partial Feature and defect fixes.
Authored: Alan Barrett, 29 Jan 1997
mmap-overview patch At http://www.xs4all.nl/~johnpc/inn/
The patch itself is also available at:
ftp://ftp.isc.org/isc/inn/unoff-patches/1.5.1/mmap-overview.patch
22 Kb Thu Mar 06 23:09:00 1997
Type: Performance/Resource
Symptom: Allows multiple nnrpd's to share .overview images in memory.
The patch also includes an MMAP testing function to determine if
MMAP works on your OS
Applies to: INN-1.5.1: Various
OS: all
Incorporated into stock 1.5.1: No
Incorporated into stock 1.5.1sec2: No
Incorporated into stock inn1.5.1corr/1.7: No. It does not fix a defect.
Incorporated into stock 1.6b3: No.
Authored: Jan-Pieter Cornet, 6 Mar 1997
ftp://ftp.isc.org/isc/inn/unoff-patches/1.5.1/nnrpd-mmap-shared-active.patch
"For people running inn1.5, here is a patch to nnrpd that maps the active file SHARED+RO. This
is different from the shared-memory-active file patch. This patch uses mmap() and takes a
different approach. For news machines with large (900K+) active files, this patch will cut the
nnrpd memory usage in half."(At Utilities by Matt Dillon)
13 Kb Tue Feb 04 16:01:00 1997
Type: Resource (nnrpd memory usage)
Symptom: Allows multiple nnrpd's to share read-only active file images.
Applies to: INN-1.5.1/nnrpd/ various
OS: all
Incorporated into stock 1.5.1: No
Incorporated into stock 1.5.1sec2: No
Incorporated into stock inn1.5.1corr/1.7: No. It does not fix a defect.
Incorporated into stock 1.6b3: Yes
Authored: Matt Dillon, 4 Feb 1997
Can I use MMAP? See MMAP testing function in mmap-overview.patch
Applying to INN 1.5
Applying to INN 1.4
ftp://ftp.isc.org/isc/inn/unoff-patches/1.4unoff4/apb-stream-prio.patch
4 Kb Mon Jun 03 00:00:00 1996
Type: Performance (Response delay)
Symptom: inn is slow to respond to reader connects when incoming is
using streaming. This patch divides INN's work into smaller
pieces to prevent "starvation."
Applies to: INN-1.4unoff4/innd/chan.c
OS: all
Incorporated into 1.5.1: Yes. Controlled by innd/chan.c::PRIORITISE_REMCONN,
which is NOT in config.data.
Authored: Alan Barret, 2 Jun 1996
ftp://ftp.isc.org/isc/inn/unoff-patches/1.4unoff4/bird-streaming.patch1
17 Kb Sun May 26 00:00:00 1996
Type: Multiple. Bug fixes, streaming improvements
Symptom: Increases streaming throughput, spurious log message, memory corruption.
Applies to: INN-1.4unoff4/backends/innxmit.c
OS: all, (with workaround for a Linux 1.2.X TCP bug)
Incorporated into 1.5.1:
Authored: Mike Bird, 24 May 1996
innd-timer-14u4.tgz (At Joe Greco's INN Patch Shop)
Also: innd-timer-151.tgz
"..is a combination patch and new files that will provide profiling information about where your innd is spending its time. I will write a notes page sometime, I hope, as the output is a bit cryptic."
ftp://ftp.isc.org/isc/inn/unoff-patches/1.4unoff4/sharedactive.patch
15 Kb Wed Mar 20 00:00:00 1996
Type: Resource (nnrpd memory usage)
Symptom: Each nnrpd keeps it's own copy of the active file. This permits all
nnrpd's to share one copy.
Applies to INN: 1.4unoff4
OS: various
Incorporated into 1.5.1: No, See nnrpd-mmap-shared-active.patch (listed in
INN Patches by Topic: Readers)
Authored:?, 20 Mar 1996
Can I use MMAP? See MMAP testing function in mmap-overview.patch
ftp://ftp.isc.org/isc/inn/unoff-patches/1.4unoff4/makehistory-dbz.patch
2 Kb Tue May 13 15:33:00 1997
Type: Major Performance bug
Symptom: makehistory takes a very long time
Applies to INN: 1.4unoff4/expire/makehistory.c
OS: all
Incorporated into 1.5.1: Yes, but there is a patch for INN 1.5
Authored: Otto J. Makela, 23 Apr 1997
RKT Rapid-Links:[Search] [RKT Tips] Path: / Usenet RKT / For Providers / INN Patches / 0004.htm
You can find a summary and links related to this topic
as part of the Mib Software Usenet RKT.