Dirk Engling
d3f8013a18
Introducing multiscrape
16 years ago
Dirk Engling
463aabe5f7
Prevent url-decoding for debug by using a temp buffer
16 years ago
Dirk Engling
33530a2ac6
Those stupid "announce ?info_hash" torrents get really annoying. Fix it in announce and scrape.
16 years ago
Dirk Engling
e0f88d7545
be more verbose about what full scrape consumers deliver in their http requests
16 years ago
Dirk Engling
71436d6b24
After studying opentracker live data, I decided to radically reduce default allocation for vectors and making it grow faster instead: Most pools only had one or two peers, wasting 8*15 or 8*14 bytes.
16 years ago
Dirk Engling
b7e8a852e8
Remove an unused variable
16 years ago
Dirk Engling
547463a21f
Release exactly all unused bytes in mmap allocation.
16 years ago
Dirk Engling
8c3624ce9d
give opentracker the missing header file
16 years ago
Dirk Engling
dd7c0a3cab
Must not dealloc mmaped buffers with free()
16 years ago
Dirk Engling
61204221c1
Fix misunderstandig of what libowfat thinks are seconds and what I did...
16 years ago
Dirk Engling
6891fa78bc
Increase check interval for timeouted sockets to 10 seconds. That may prevent some disrupted scrapes.
16 years ago
Dirk Engling
cafb0d45fe
Since array and io_batch are in a union, and we also have time-outing writable sockets, we need to mark, which of the union is used. Also remove the blessed flag from struct http, since its rarely used and can be done in a seperate memcmp.
16 years ago
Dirk Engling
53054700c8
Cannot access members after they are freed :/
16 years ago
Dirk Engling
2c3b4e3de7
Save a lot of work when skipping through uninteresting http request parameters
16 years ago
Dirk Engling
91d3e4b6ef
Make fromhex() even faster
16 years ago
Dirk Engling
cc78f4d304
fixed one performance bug, where "skipping values from a ¶m=values pair" was requested, the requestor ended up with "values" to be parsed again.
...
improved performance of fromhex
improved performance of is_unreserved() by moving it all into a simple byte array
improved performance of %41 => 'A' conversion by reordering variables
16 years ago
Dirk Engling
b61651394a
Increase send timeout. Also use an own variable for that.
16 years ago
Dirk Engling
1d4eb17452
Increase send timeout. Also use an own variable for that.
16 years ago
Dirk Engling
23465c215a
io_timeout is absolute, not relative :/
16 years ago
Dirk Engling
7d4db8015d
Free iobatches on timeout
16 years ago
Dirk Engling
938d063919
HEADS UP: you need to check out the latest libowfat! Huge allocations are now taken from mmap()ed regions, not from heap anymore
16 years ago
Dirk Engling
962ad63424
Sockets we write to now do also timeout
16 years ago
Dirk Engling
7a65f9ca73
Fixed 24h clean bug. Allocate less memory for full scrape. Free torrents without any downloaders immediately.
16 years ago
Dirk Engling
5b82b40439
Exclude empty torrents from full scrape, also try to shrink full scrape buffer after it is full
16 years ago
Dirk Engling
9ffe557e6f
fixed line breaks in log
16 years ago
Dirk Engling
1815dd3e53
Log all expansive operations to stderr
16 years ago
Dirk Engling
854c21cece
Most open trackers do not have the problem of not being called often enough.. so do not introduce an extra timeout when waiting for activity. That also removes one of the last extraneous gettimeofday calls
16 years ago
Dirk Engling
7a3ddcfbce
since gettimeofday is rather expansive, we do only fetch time once in a 5 second period, when we are delivered a SIGALRM.
16 years ago
Dirk Engling
b3f834951c
make 64bit safe
16 years ago
Dirk Engling
332a481e47
There is a pool leak somewhere... try to find it
16 years ago
Denis Ahrens
943b296f46
fixed some stat output
16 years ago
Dirk Engling
68d87742fa
Two more bugs in Makefile. Maybe I learn it one day
16 years ago
Dirk Engling
3e71f32d26
Revert debug option in Makefile
16 years ago
Dirk Engling
c6d90b150d
Makefile now runs under bsdmake and gnumake again
16 years ago
Dirk Engling
4319defc9c
New stats for s24s code, this is debug, do not use in real world
16 years ago
Denis Ahrens
976987d4a3
fixed a small bug with 0 torrents and a cosmetical one
16 years ago
Dirk Engling
6bad28c924
Makefile defaults to an _open_ tracker again.
16 years ago
Dirk Engling
c863c6e108
An announce with event=stopped now returns correct number of leechers and seeders. In TCP and UDP.
16 years ago
Dirk Engling
1911aa7328
Fixed the inverse interpretation of black/white listing
16 years ago
Dirk Engling
d58db69d9a
Added whitelisting to reimplement the WANT_CLOSED_TRACKER functionality
16 years ago
Dirk Engling
42433aef94
Under Linux one gets SIG_ALRMs from time to time when using epoll. Ignore those.
16 years ago
Dirk Engling
7043b69e49
Sort of addressed a concorrency issue when receiving mutliple SIG_HUPs
16 years ago
Dirk Engling
7abbe1294b
off by -1... or so, strange error class
16 years ago
Dirk Engling
61ed0bd785
Fix endianess issue in /24 stats code
16 years ago
Dirk Engling
6382386416
some subnet stats... still ugly and untested.
16 years ago
Dirk Engling
8ef59b0351
* fixed "nobody " -> "nobody" fuckup when getpwnam-ing
...
* implemented basic blacklisting:
** the file specified with -b <BLACKLIST> is read and added to a blacklist vector
** if an announce hits a torrent in that blacklist vector, add_peer_to_torrent fails
** sending a SIGHUP to the program forces it to reread the blacklists
** the server returns with a 500, which is not exactly nice but does the job for now
** an adaequat "failure reason:" should be delivered... TODO
16 years ago
Dirk Engling
bd1562f8bd
Clean up pw-structs
16 years ago
Denis Ahrens
f8c2f994ff
add comment for udp spec location
16 years ago
Denis Ahrens
4f173a3334
check for mafic udp id
16 years ago
Denis Ahrens
7cebcfb54e
need more space for data because we reach this limit easily now
16 years ago