router not restarting, hung, not reproducible

[DISABLED]

I hit restart button. After the 11 minutes passed I could not access the router cosnole anymore, but i2prouter status said running…

I2P version: 0.8.11-5
Java version: Sun Microsystems Inc. 1.6.0_22 (OpenJDK Runtime Environment 1.6.0_22-b22)
Wrapper version: 3.5.12
Server version: Jetty/5.1.15
Platform: Linux amd64 2.6.37.6-0.9-desktop
Processor: AMD Turion X2/Athlon X2/Sempron (Lion/Sable?, 65 nm) (athlon64)
Jbigi: Locally optimized native BigInteger? library loaded from file
Encoding: UTF-8

[code]
…
2011/11/24 21:19:05 | Error writing to ping file
2011/11/24 21:19:05 | java.io.FileNotFoundException?: /home/xxx/.i2p/router.ping (Too many files open)
2011/11/24 21:19:05 | at java.io.FileOutputStream?.open(Native Method)
2011/11/24 21:19:05 | at java.io.FileOutputStream?.<init>(FileOutputStream?.java:209)
2011/11/24 21:19:05 | at java.io.FileOutputStream?.<init>(FileOutputStream?.java:160)
2011/11/24 21:19:05 | at net.i2p.util.SecureFileOutputStream?.<init>(SecureFileOutputStream?.java:42)
2011/11/24 21:19:05 | at net.i2p.router.Router$MarkLiveliness?.ping(Router.java:1838)
2011/11/24 21:19:05 | at net.i2p.router.Router$MarkLiveliness?.timeReached(Router.java:1830)
2011/11/24 21:19:05 | at net.i2p.util.SimpleScheduler?$RunnableEvent?.run(SimpleScheduler?.java:155)
2011/11/24 21:19:05 | at net.i2p.util.SimpleScheduler?$PeriodicRunnableEvent?.run(SimpleScheduler?.java:184)
2011/11/24 21:19:05 | at java.util.concurrent.Executors$RunnableAdapter?.call(Executors.java:471)
2011/11/24 21:19:05 | at java.util.concurrent.FutureTask?$Sync.innerRunAndReset(FutureTask?.java:351)
2011/11/24 21:19:05 | at java.util.concurrent.FutureTask?.runAndReset(FutureTask?.java:178)
2011/11/24 21:19:05 | at java.util.concurrent.ScheduledThreadPoolExecutor?$ScheduledFutureTask?.access$201(ScheduledThreadPoolExecutor?.java:165)
2011/11/24 21:19:05 | at java.util.concurrent.ScheduledThreadPoolExecutor?$ScheduledFutureTask?.run(ScheduledThreadPoolExecutor?.java:267)
2011/11/24 21:19:05 | at java.util.concurrent.ThreadPoolExecutor?.runWorker(ThreadPoolExecutor?.java:1110)
2011/11/24 21:19:05 | at java.util.concurrent.ThreadPoolExecutor?$Worker.run(ThreadPoolExecutor?.java:603)
2011/11/24 21:19:05 | at java.lang.Thread.run(Thread.java:679)
2011/11/24 21:20:00 | Error writing to ping file
2011/11/24 21:20:00 | java.io.FileNotFoundException?: /home/xxx/.i2p/router.ping (Too many files open)
2011/11/24 21:20:00 | at java.io.FileOutputStream?.open(Native Method)
2011/11/24 21:20:00 | at java.io.FileOutputStream?.<init>(FileOutputStream?.java:209)
2011/11/24 21:20:00 | at java.io.FileOutputStream?.<init>(FileOutputStream?.java:160)
2011/11/24 21:20:00 | at net.i2p.util.SecureFileOutputStream?.<init>(SecureFileOutputStream?.java:42)
2011/11/24 21:20:00 | at net.i2p.router.Router$MarkLiveliness?.ping(Router.java:1838)
2011/11/24 21:20:00 | at net.i2p.router.Router$MarkLiveliness?.timeReached(Router.java:1830)
2011/11/24 21:20:00 | at net.i2p.util.SimpleScheduler?$RunnableEvent?.run(SimpleScheduler?.java:155)
2011/11/24 21:20:00 | at net.i2p.util.SimpleScheduler?$PeriodicRunnableEvent?.run(SimpleScheduler?.java:184)
2011/11/24 21:20:00 | at java.util.concurrent.Executors$RunnableAdapter?.call(Executors.java:471)
2011/11/24 21:20:00 | at java.util.concurrent.FutureTask?$Sync.innerRunAndReset(FutureTask?.java:351)
2011/11/24 21:20:00 | at java.util.concurrent.FutureTask?.runAndReset(FutureTask?.java:178)
2011/11/24 21:20:00 | at java.util.concurrent.ScheduledThreadPoolExecutor?$ScheduledFutureTask?.access$201(ScheduledThreadPoolExecutor?.java:165)
2011/11/24 21:20:00 | at java.util.concurrent.ScheduledThreadPoolExecutor?$ScheduledFutureTask?.run(ScheduledThreadPoolExecutor?.java:267)
2011/11/24 21:20:00 | at java.util.concurrent.ThreadPoolExecutor?.runWorker(ThreadPoolExecutor?.java:1110)
2011/11/24 21:20:00 | at java.util.concurrent.ThreadPoolExecutor?$Worker.run(ThreadPoolExecutor?.java:603)
2011/11/24 21:20:00 | at java.lang.Thread.run(Thread.java:679)
2011/11/24 21:20:46 | java.net.SocketException?: Too many files open
2011/11/24 21:20:55 | Error writing to ping file
2011/11/24 21:20:55 | java.io.FileNotFoundException?: /home/xxx/.i2p/router.ping (Too many files open)
2011/11/24 21:20:55 | at java.io.FileOutputStream?.open(Native Method)
2011/11/24 21:20:55 | at java.io.FileOutputStream?.<init>(FileOutputStream?.java:209)
2011/11/24 21:20:55 | at java.io.FileOutputStream?.<init>(FileOutputStream?.java:160)
2011/11/24 21:20:55 | at net.i2p.util.SecureFileOutputStream?.<init>(SecureFileOutputStream?.java:42)
2011/11/24 21:20:55 | at net.i2p.router.Router$MarkLiveliness?.ping(Router.java:1838)
2011/11/24 21:20:55 | at net.i2p.router.Router$MarkLiveliness?.timeReached(Router.java:1830)
2011/11/24 21:20:55 | at net.i2p.util.SimpleScheduler?$RunnableEvent?.run(SimpleScheduler?.java:155)
2011/11/24 21:20:55 | at net.i2p.util.SimpleScheduler?$PeriodicRunnableEvent?.run(SimpleScheduler?.java:184)
2011/11/24 21:20:55 | at java.util.concurrent.Executors$RunnableAdapter?.call(Executors.java:471)
2011/11/24 21:20:55 | at java.util.concurrent.FutureTask?$Sync.innerRunAndReset(FutureTask?.java:351)
2011/11/24 21:20:55 | at java.util.concurrent.FutureTask?.runAndReset(FutureTask?.java:178)
2011/11/24 21:20:55 | at java.util.concurrent.ScheduledThreadPoolExecutor?$ScheduledFutureTask?.access$201(ScheduledThreadPoolExecutor?.java:165)
2011/11/24 21:20:55 | at java.util.concurrent.ScheduledThreadPoolExecutor?$ScheduledFutureTask?.run(ScheduledThreadPoolExecutor?.java:267)
2011/11/24 21:20:55 | at java.util.concurrent.ThreadPoolExecutor?.runWorker(ThreadPoolExecutor?.java:1110)
2011/11/24 21:20:55 | at java.util.concurrent.ThreadPoolExecutor?$Worker.run(ThreadPoolExecutor?.java:603)
2011/11/24 21:20:55 | at java.lang.Thread.run(Thread.java:679)
2011/11/24 21:28:13 | 24-nov-2011 20:28:13 org.mortbay.util.ThreadedServer?$Acceptor run
2011/11/24 21:28:13 | INFO: Stopping Acceptor ServerSocket?[addr=/0:0:0:0:0:0:0:1,port=0,localport=7657]
2011/11/24 21:28:13 | 24-nov-2011 20:28:13 org.mortbay.http.SocketListener? stop
2011/11/24 21:28:13 | INFO: Stopped SocketListener? on 0:0:0:0:0:0:0:1:7657
2011/11/24 21:28:13 | 24-nov-2011 20:28:13 org.mortbay.util.ThreadedServer?$Acceptor run
2011/11/24 21:28:13 | INFO: Stopping Acceptor ServerSocket?[addr=/127.0.0.1,port=0,localport=7657]
2011/11/24 21:28:14 | 24-nov-2011 20:28:14 org.mortbay.http.SocketListener? stop
2011/11/24 21:28:14 | INFO: Stopped SocketListener? on 127.0.0.1:7657
2011/11/24 21:28:14 | 24-nov-2011 20:28:14 org.mortbay.util.Container stop
2011/11/24 21:28:14 | INFO: Stopped org.mortbay.jetty.servlet.WebApplicationHandler?@2e1551b0
2011/11/24 21:28:14 | 24-nov-2011 20:28:14 org.mortbay.util.Container stop
2011/11/24 21:28:14 | INFO: Stopped WebApplicationContext?i2psnark,/i2psnark
2011/11/24 21:28:14 | 24-nov-2011 20:28:14 org.mortbay.util.Container stop
2011/11/24 21:28:14 | INFO: Stopped org.mortbay.jetty.servlet.WebApplicationHandler?@45c3987
2011/11/24 21:28:14 | 24-nov-2011 20:28:14 org.mortbay.util.Container stop
2011/11/24 21:28:14 | INFO: Stopped WebApplicationContext?addressbook,/addressbook
2011/11/24 21:28:14 | CRIT [hutdown hook] net.i2p.router.Router : Graceful shutdown progress - no more tunnels, safe to die
2011/11/24 21:28:14 | SeedlessCache? Exited.
2011/11/24 21:29:11 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:30:11 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:30:46 | java.net.ConnectException?: Connection denied
2011/11/24 21:31:21 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:32:31 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:33:41 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:34:51 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:35:20 | java.net.ConnectException?: Connection denied
2011/11/24 21:35:51 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:37:01 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:38:11 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:39:21 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:40:31 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:40:46 | java.net.ConnectException?: Connection denied
2011/11/24 21:41:41 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:42:51 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:44:01 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:45:11 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:45:20 | java.net.ConnectException?: Connection denied
2011/11/24 21:46:21 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:47:31 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:48:41 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:49:42 | Proxy not quite ready yet, will retry in 60 seconds.
2011/11/24 21:50:46 | java.net.ConnectException?: Connection denied
2011/11/24 21:55:20 | java.net.ConnectException?: Connection denied
2011/11/24 22:00:46 | java.net.ConnectException?: Connection denied
2011/11/24 22:01:13 | java.net.ConnectException?: Connection denied
2011/11/24 22:05:20 | java.net.ConnectException?: Connection denied
2011/11/24 22:10:46 | java.net.ConnectException?: Connection denied
2011/11/24 22:14:02 | TERM trapped. Shutting down.
2011/11/24 22:14:03 | 24-nov-2011 21:14:03 org.mortbay.jetty.Server$ShutdownHookThread? run
2011/11/24 22:14:03 | INFO: Shutdown hook executing
2011/11/24 22:14:03 | SeedlessServer? Exited.
2011/11/24 22:14:03 | Seedless server context destroyed
2011/11/24 22:14:06 | ←- Wrapper Stopped
2011/11/24 22:14:07 | —> Wrapper Started as Daemon
2011/11/24 22:14:07 | Java Service Wrapper Community Edition 64-bit 3.5.12
2011/11/24 22:14:07 | Copyright © 1999-2011 Tanuki Software, Ltd. All Rights Reserved.
2011/11/24 22:14:07 | ​http://wrapper.tanukisoftware.com
2011/11/24 22:14:07 |
2011/11/24 22:14:08 | Launching a JVM…
2011/11/24 22:14:10 | WrapperManager?: Initializing…

[killyourtv]

For this part

2011/11/24 21:19:05 | Error writing to ping file
2011/11/24 21:19:05 | java.io.FileNotFoundException?: /home/xxx/.i2p/router.ping (Too many files open)

check out ​http://lj4newbies.blogspot.com/2007/04/too-many-open-files.html for instructions to solve it.

For the main issue, I wonder if it's related to #544.

2011/11/24 21:28:14 | SeedlessCache Exited.

[..snipped..]

I presume at this point, nearly an hour later, you used i2prouter stop

2011/11/24 22:14:02 | TERM trapped. Shutting down.
2011/11/24 22:14:03 | 24-nov-2011 21:14:03 org.mortbay.jetty.Server$ShutdownHookThread? run
2011/11/24 22:14:03 | INFO: Shutdown hook executing
2011/11/24 22:14:03 | SeedlessServer? Exited.
2011/11/24 22:14:03 | Seedless server context destroyed
2011/11/24 22:14:06 | <-- Wrapper Stopped

[zzz]

assigning to sponge, possibly same issue as in #544

[DISABLED]

Replying to killyourtv:

For the main issue, I wonder if it's related to #544.

#544 is on 0.8.10-5 which I used too and which showed the same problem on upgrade restart as mine. but that I only had with 0.8.10-5 and not with the other dev builds in between. And there the routerconsole was accessible. Not so now.

and just like the reporter of #544, I am not manually using jetty outside of i2p's JVM. What seedless does and does not, I cannot tell.

I presume at this point, nearly an hour later, you used i2prouter stop

2011/11/24 22:14:02 | TERM trapped. Shutting down.
2011/11/24 22:14:03 | 24-nov-2011 21:14:03 org.mortbay.jetty.Server$ShutdownHookThread? run
2011/11/24 22:14:03 | INFO: Shutdown hook executing
2011/11/24 22:14:03 | SeedlessServer? Exited.
2011/11/24 22:14:03 | Seedless server context destroyed
2011/11/24 22:14:06 | <-- Wrapper Stopped

correct.

[sponge]

2011/11/24 21:19:05 | Error writing to ping file
2011/11/24 21:19:05 | java.io.FileNotFoundException??: /home/xxx/.i2p/router.ping (Too many files open)

You are out of FD's See #545