Chronological feed of everything captured from Bindu Reddy.
paper / bindureddy / Jun 13
Transformer hidden states' standard basis dimensions directly encode semantic content through sign patterns (binary features) and magnitudes (confidence), eliminating the need for learned feature bases or training. Sign patterns alone achieve 72-93% top-5 accuracy and enable unsupervised discovery of 1500+ semantic features across model families via single-token caching, establishing that mechanistic interpretability requires no optimization beyond a single forward pass per vocabulary token.
mechanistic-interpretabilitytransformer-internalsfeature-discoverytraining-free-methodsinterpretability-researchneural-network-analysis
“Sign patterns of transformer hidden state dimensions achieve 72-93% top-5 next-token prediction accuracy when all magnitudes are replaced with unity”
paper / bindureddy / Jun 13
Using deep JWST/NIRSpec spectroscopy of 688 star-forming galaxies at z~3, this study reveals that galactic gas flows are fundamentally oriented perpendicular (outflows) or parallel (inflows) to disk geometry, consistent with theoretical predictions. Outflow velocity shows no correlation with galaxy properties like mass or SFR, but galaxies with detected outflows skew toward higher stellar mass and star formation rates, indicating selection effects. Critically, galaxies' inclination angle predicts gas flow signatures: face-on systems show stronger absorption and higher outflow velocities, while inclined disks preferentially exhibit inflow signatures—a pattern consistent with low-redshift observations and simulations.
jwstgalaxy-formationgas-flowshigh-redshiftspectroscopyastrophysicsnirspec
“Outflow velocity in z~3 star-forming galaxies shows no statistically significant correlation with galaxy stellar mass, SFR, or surface density of SFR”
paper / bindureddy / Jun 13
DNS simulations of Rayleigh-Darcy convection reveal a distinct transition to an ultimate regime at Ra ≈ 4×10⁵ where Nusselt number maintains approximately linear scaling with Ra. This scaling persistence stems from progressive refinement of near-wall protoplumes that merge into megaplumes, with finer structures emerging at higher Ra despite shifting thermal dissipation from boundary layers to the bulk. The thermal boundary-layer thickness scaling (Ra⁻¹) combined with increased protoplume density generates efficient heat transport across the entire domain.
rayleigh-darcy-convectionheat-transfer-scalingporous-media-flowthermal-boundary-layerdns-simulationfluid-dynamics
“Nusselt number exhibits approximately linear dependence on Ra throughout Ra ∈ [10³, 10⁶] with a distinct change in slope at Ra ≈ 4×10⁵”
paper / bindureddy / Jun 9
Generative AI models for drug design excel with deep pockets but falter on shallow ones, exemplified by targets like KRAS and MYC. The newly introduced ShallowBench, containing 5,780 shallow-pocket targets from CrossDocked2020, evaluates these models, revealing their weaker performance on such targets. This highlights the need for novel architectures or loss functions to address these challenging binding sites.
ai-drug-discoverygenerative-modelsbenchmarkingprotein-structuremolecular-designstructure-based-drug-designshallow-pockets
“Generative AI models demonstrate success in structure-based drug design primarily for targets with deep binding pockets.”
paper / bindureddy / Jun 9
This research introduces a lighting-aware representation learning framework that treats illumination variation as an explicit training signal, diverging from conventional invariance-focused data augmentation. By extending contrastive learning with an auxiliary objective for illumination-dependent variations, the model learns robust representations that maintain semantic consistency while adapting to lighting-induced structural changes. Evaluations on benchmark datasets show consistent performance improvements in downstream tasks like image classification and object detection compared to standard contrastive learning.
contrastive-learningillumination-robustnessvisual-representation-learningdata-augmentationimage-classificationobject-detectioncomputer-vision
“Existing methods for handling illumination variations in visual representation learning focus on data augmentation to achieve invariance, rather than explicitly modeling lighting information.”
paper / bindureddy / Jun 9
This work introduces a compiler-agnostic methodology enabling High-Level Synthesis (HLS) tools to directly target domain-specific FPGA hardblocks. By abstracting hardblocks as C-level operators with explicit latency and initiation-interval contracts, the approach allows HLS schedulers to optimize specialized hardware without manual RTL integration. Evaluations on a Tensor Slice-based architecture demonstrate that this method yields lower area-delay products and improved productivity-adjusted efficiency compared to baseline HLS and handwritten RTL, respectively, while enhancing accessibility of specialized FPGA architectures.
fpga-designhigh-level-synthesishardware-accelerationartificial-intelligencemachine-learningcompiler-design
“High-level synthesis (HLS) tools can be utilized to directly target custom FPGA hardblocks from C/C++ code, eliminating the need for manual Register-Transfer Level (RTL) integration.”
paper / bindureddy / Jun 6 / failed
paper / bindureddy / Jun 6 / failed
paper / bindureddy / Jun 6 / failed
paper / bindureddy / Jun 6 / failed
paper / bindureddy / May 29 / failed
paper / bindureddy / May 29 / failed
paper / bindureddy / May 29 / failed
paper / bindureddy / May 29 / failed
paper / bindureddy / May 23 / failed
paper / bindureddy / May 23 / failed
paper / bindureddy / May 23 / failed
paper / bindureddy / May 18 / failed
paper / bindureddy / May 18 / failed
paper / bindureddy / May 18 / failed
paper / bindureddy / May 13 / failed
paper / bindureddy / May 13 / failed
paper / bindureddy / May 13 / failed
paper / bindureddy / May 11 / failed
paper / bindureddy / May 11 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
tweet / @bindureddy / May 8 / failed
paper / bindureddy / May 8 / failed
paper / bindureddy / May 8 / failed
paper / bindureddy / May 8 / failed