maxpool - Network

Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle...

Double Descent Demystified: Identifying, Interpreting & Ablating the Sources of a Deep Learning Puzzle https://arxiv.org/abs/2303.14151

... We provide visual intuition using polynomial regression, then mathematically analyze double descent with ordinary linear regression and identify three interpretable factors that, when simultaneously all present, together create double descent.

Double descent will not occur if any of the three factors are absent.

1. Small-but-nonzero singular values do not appear in the training data features.

2. The test datum does not vary in different directions than the training features (same subspace)

3. The best possible model in the model class makes no errors on the training data.

Intuition extends to nonlinear models

#DeepLearning #ml #machineLearning #ai

A Math Lesson From Hitler’s Germany https://undark.org/2017/02/01/math-lesson-hitlers-germany/Robbert Dijkgraaf, the current director of...

A Math Lesson From Hitler’s Germany https://undark.org/2017/02/01/math-lesson-hitlers-germany/

Robbert Dijkgraaf, the current director of the Institute for Advanced Study:

“In some sense every scholar is at risk, It’s not so much that people are persecuted because of their beliefs, but there is a certain trend where careful reasoning, the search for truth, all the delicacies of having a balanced point of view, acting on facts, being honest about what you do and don’t know, your uncertainty, all these values we have in science and scholarship are at risk.”

#academia #science #usa #uspol

Passing planes and other whoosh sounds by @windytan https://www.windytan.com/2025/04/passing-planes-and-other-whoosh-sounds.htmlDoppler...

Passing planes and other whoosh sounds by @windytan https://www.windytan.com/2025/04/passing-planes-and-other-whoosh-sounds.html

Doppler effect, fourier tranform,
Comb filtering, cepstrum, echo

#DSP #sound #signalProsessing #acoustics #audio

Wait. HOW MANY supernova explode every year?THIRTY SUPERNOVAE PER SECOND, over the entire observable Universe....

Wait. HOW MANY supernova explode every year?

THIRTY SUPERNOVAE PER SECOND, over the entire observable Universe.

https://badastronomy.beehiiv.com/p/ban-447-wait-how-many-supernova-explode

#astronomy

Taxonomy of action. #democracy #civicduty #politics

Taxonomy of action.

#democracy #civicduty #politics

Happines vs GDP per capita.Generally money can buy happiness, but some countries get more happiness with less. Finland is the Pursuit of...

Happines vs GDP per capita.

Generally money can buy happiness, but some countries get more happiness with less.

Finland is the Pursuit of Happiness Champion. Mexico and Vietnam are very efficient in their pursuit (GDP is in log scale).

#economics #happiness #Finland

The surface of an EUV mirror must be polished to 53 picometers rms. That is the absolute wavefront error allowed for the whole system....

The surface of an EUV mirror must be polished to 53 picometers rms. That is the absolute wavefront error allowed for the whole system. That is the atomic radius of the smallest atom, the hydrogen atom.

How the EUV Mirrors are Made
https://www.youtube.com/watch?v=QdESABi1Avk

#semiconductors #optics #technology #metrology

Asshat - a very relevant world today.Asshat is a new addition to the English language. Recent research has found evidence of use from the...

Asshat - a very relevant world today.

Asshat is a new addition to the English language. Recent research has found evidence of use from the late 1990s, in Usenet groups.
https://www.merriam-webster.com/wordplay/some-notes-on-asshat-word-history

The first entry on Urban Dictionary appears in 2002, defining the term as “One who has their head up their ass. Thus wearing their ass as a hat.” https://www.dictionary.com/e/slang/asshat/

#words #english #trump

Cells are swapping their mitochondria. What does this mean for our health?https://www.nature.com/articles/d41586-025-01064-5#cellbiology

Cells are swapping their mitochondria. What does this mean for our health?
https://www.nature.com/articles/d41586-025-01064-5

#cellbiology

Exploring ultraweak photon emissions as optical markers of brain activityhttps://www.cell.com/iscience/fulltext/S2589-0042(25)00279-2Brains...

Exploring ultraweak photon emissions as optical markers of brain activity
https://www.cell.com/iscience/fulltext/S2589-0042(25)00279-2

Brains are highly metabolic organs that emit ultraweak photon emissions (UPEs)

Tt remains uncertain whether passive light emissions can be used to infer brain states as electric and magnetic fields do for encephalography. We present evidence that brain UPEs differ from background light in spectral and entropic properties, respond dynamically to tasks and stimulation, and correlate moderately with brain rhythms.

#neuroscience #bci

3rd method if inheritance besides DNA and RNA: Amyloid-like protein structures that have the ability to replicate making them possible...

3rd method if inheritance besides DNA and RNA: Amyloid-like protein structures that have the ability to replicate making them possible inheritance vectors.

Noncanonical inheritance of phenotypic information by protein amyloids https://www.nature.com/articles/s41556-024-01494-9

>we identify amyloid-like protein structures that are stably inherited in wild-type animals and influence traits. Their perturbation by genetic, environmental or pharmacological treatments leads to developmental phenotypes that can be epigenetically passed onto progeny.

#biology #cellbiology #epigenetics #genetics #biochemistry

The end of this tariff kerfuffle is:a 'Deal' where we end close to the starting point.Actual deal where the US gets something...

The end of this tariff kerfuffle is:

a 'Deal' where we end close to the starting point.
Actual deal where the US gets something real.
Current tariffs go on more than a year.
something else, what?

Simulating Trade Policy Changes with KITE Insta-analysis from Kiel Institute Trade Policy Evaluation shows that the US is going to suffer...

Simulating Trade Policy Changes with KITE Insta-analysis from Kiel Institute Trade Policy Evaluation shows that the US is going to suffer most from the tariffs and retaliatory tariffs. Other nations don't suffer nearly as much.

Under the new plan U.S
real output drops -1.92%
price index jump +9.16%
exports fall -24.52%

https://www.ifw-kiel.de/institute/research-centers/trade/trade-policy/kite-kiel-institute-trade-policy-evaluation/

On the same note Atlanta Fed GDPNow latest estimate:
-3.7 percent — April 01, 2025
https://www.atlantafed.org/cqer/research/gdpnow?

#trade #tariff #uspol #economics #USeconomy

Schooled by Trump, Americans are learning to dislike their allies....

Schooled by Trump, Americans are learning to dislike their allies. https://www.economist.com/graphic-detail/2025/03/31/schooled-by-trump-americans-are-learning-to-dislike-their-allies

❝Before the election our YouGov polling showed that just 12% of Republican voters thought that Canada was “unfriendly” or an “enemy”. In the most recent survey, which took place between March 22nd and 25th, that share more than doubled to 27% (these negative feelings were increasing before the election, too). Similarly, last year 17% of Republicans viewed the EU as “unfriendly” or as an “enemy”; that has now grown to 29%.❞

#politics #InternationalRelations #propaganda #uspol

Excitable cells. A demonstration of how reentry tachyarrhythmias can develop in a system of excitable cells....

Excitable cells. A demonstration of how reentry tachyarrhythmias can develop in a system of excitable cells. https://jenevoldsen.com/posts/excitable-cells/

#arrhythmia #health #heart

The Bartleby Strategyhttps://www.bostonreview.net/articles/judith-levine-bartleby-strategy/Our democracy may depend on government workers,...

The Bartleby Strategy
https://www.bostonreview.net/articles/judith-levine-bartleby-strategy/

Our democracy may depend on government workers, and indeed all of us, saying “I would prefer not to.”

#uspol #uspolitics #trump #resistance #democracy

Which is the greater existential risk?#ai #politics #futurologyArtificial IntelligenceNatural Stupidity

Which is the greater existential risk?

#ai #politics #futurology

Artificial Intelligence
Natural Stupidity

The Lighthill debate on Artificial Intelligence May 9, 1973https://www.youtube.com/watch?v=03p2CADwGF8Artificial Intelligence: A General...

The Lighthill debate on Artificial Intelligence May 9, 1973

https://www.youtube.com/watch?v=03p2CADwGF8

Artificial Intelligence: A General Survey, commonly known as the Lighthill report
https://rodsmith.nz/wp-content/uploads/Lighthill_1973_Report.pdf

https://en.wikipedia.org/wiki/Lighthill_report

#ai #history #video

“Kai su Teknon?” - Caesar's last words."And the Romans of course were obsessed with classical Greece and their culture was...

“Kai su Teknon?” - Caesar's last words.

"And the Romans of course were obsessed with classical Greece and their culture was hugely “Greco-Roman,” so much so that the primary language spoken amongst the Roman aristocracy well into the Empire was Greek ... it is believed that most of the early Emperors spoke and wrote primarily in Greek and only seldom used Latin- and only when speaking to common people. Cicero actually had to invent an entirely new Latin vocabulary from Greek so that he could share philosophical, political and other academic concepts with common Romans because Latin did not have the prerequisite vocabulary in his time. In fact, It is recorded that the Emperor Hadrian complained about his administration being so dominated by Greeks and the Greek language that he had to start firing his own chief administrators that did not learn and administrate in Latin going forward. " https://old.reddit.com/r/AskHistorians/comments/1j7kkhs/did_the_romans_study_and_obsess_over_a_great/mgxywbk/

#TIL #history #ancientRome #askHistorians

Differentiable Logic Cellular Automata https://google-research.github.io/self-organising-systems/difflogic-ca/?The learning trick:1. ...

Differentiable Logic Cellular Automata https://google-research.github.io/self-organising-systems/difflogic-ca/?

The learning trick:

1. Continuous Logic Operations - During training, each logic operation is replaced by a continuous relaxation, which is a differentiable version that operates on continuous values between 0 and 1. For example, instead of a hard AND gate that only accepts 0 or 1, we use a soft AND gate that can handle values between 0 and 1 as inputs, and passes a continuous mix of the two inputs as its output. Continuous relaxations (listed below) allow us to train the network using gradient descent.

2. Probabilistic Gate Selection Each gate maintains a probability distribution over the 16 possible binary operations for two inputs. This distribution is represented by a 16-dimensional parameter vector, which is then transformed into a probability distribution using softmax. The values of the 16-dimensional vector are modified during the training process: over time, the gate learns to prefer one operation over others.

#MachineLearning