A gremlin in the coffee machine last night

grahame

Administrator
Hero Member

Posts: 43545

A gremlin in the coffee machine last night

« on: October 10, 2023, 07:17:00 »

Some unusual behaviour late yesterday evening within our database engine and we had a handful of outages no more than a few minutes each; I paused the service of Coffee a couple of times while I investigated and took additional off-site backups. Problems cleared in the early hours, but I have no definitive answer to what triggered them - just an educated guess. Issues did NOT get to the point of formally shutting for maintenance or flagging ongoing issues, but please bookmark http://status.passenger.chat in case we ever hit something more serious.

Standard advice (abundance of caution) - if you compose a long or difficult post, please keep a local copy just in case - our systems are not strong to a safety-critical standard and should the server crash or have an accident, restoration may miss some recent activity.


	Logged

Coffee Shop Admin, Chair of Melksham Rail User Group, TravelWatch SouthWest Board Member

grahame

Administrator
Hero Member

Posts: 43545

Re: A gremlin in the coffee machine last night

« Reply #1 on: October 15, 2023, 22:57:50 »

Quote from: grahame on October 10, 2023, 07:17:00

Triggered again and a Denial of Service attack caught in the act today. Gauges went off the scale but the server carried on running and because it was caught in the act I could see what was happening, block (at midday) and see that the block worked ...


	Logged

Coffee Shop Admin, Chair of Melksham Rail User Group, TravelWatch SouthWest Board Member

grahame

Administrator
Hero Member

Posts: 43545

Re: A gremlin in the coffee machine last night

« Reply #2 on: February 11, 2025, 22:16:32 »

This thread came up on my "most recent likes" ...

I was half wondering whether to post this server load (on our worker machine) from today

The spike was NOT the Coffee Shop - it was the old "Save the Train" website still hosted on the same machine which rose from under 4 accesses every minute to over 6,000 every minute for a while, all from (!) Iran. Didn't the class 141s go out there?


	Logged

Coffee Shop Admin, Chair of Melksham Rail User Group, TravelWatch SouthWest Board Member

Chris from Nailsea

Administrator
Hero Member

Posts: 19387

Re: A gremlin in the coffee machine last night

« Reply #3 on: February 12, 2025, 15:09:13 »

Quote from: grahame on February 11, 2025, 22:16:32

This thread came up on my "most recent likes" ...

That was me. Grin


	Logged

William Huskisson MP^▸ was the first person to be killed by a train while crossing the tracks, in 1830. Many more have died in the same way since then. Don't take a chance: stop, look, listen.

"Level crossings are safe, unless they are used in an unsafe manner." Discuss.

Do you have something you would like to add to this thread, or would you like to raise a new question at the Coffee Shop? Please [register] (it is free) if you have not done so before, or login (at the top of this page) if you already have an account - we would love to read what you have to say!

You can find out more about how this forum works [here] - that will link you to a copy of the forum agreement that you can read before you join, and tell you very much more about how we operate. We are an independent forum, provided and run by customers of Great Western Railway, for customers of Great Western Railway and we welcome railway professionals as members too, in either a personal or official capacity. Views expressed in posts are not necessarily the views of the operators of the forum.

As well as posting messages onto existing threads, and starting new subjects, members can communicate with each other through personal messages if they wish. And once members have made a certain number of posts, they will automatically be admitted to the "frequent posters club", where subjects not-for-public-domain are discussed; anything from the occasional rant to meetups we may be having ...

Pages: [1]

« previous next »