Skip to content
View iamr7d's full-sized avatar
🧠
I may be slow to respond.
🧠
I may be slow to respond.

Block or report iamr7d

Block user

Prevent this user from interacting with your repositories and sending you notifications. Learn more about blocking users.

You must be logged in to block users.

Content in all repositories owned by your account will be closed.
Maximum 250 characters. Please don’t include any personal information such as legal names or email addresses. This note will only be visible to you.
Report abuse

Contact GitHub support about this user’s behavior. Learn more about reporting abuse.

Report abuse
iamr7d/README.md

A film frame passing through JOY's stages: frame, foveated percept, attention map, chosen fixation

I work on models of how people watch: systems that choose where to look, perceive the consequences, and are judged against real human behaviour rather than benchmark accuracy alone. I also build products.

Currently an MRes researcher at the UAL Creative Computing Institute with Tim J. Smith. Before that: MTech in Computer Science & Engineering (AI), AI R&D at Digital University Kerala, and a co-founder of an AI interview platform. I also make films.

London · rahulrajpv.vercel.app · LinkedIn · rahulrajpv.ai@gmail.com


Building

pitute: the network for researchers
A place to find every scholarship, PhD, postdoc and research opportunity in the world, with identity drawn from academic infrastructure (ORCID, institutional email, the publication record). Live since October 2026.

  • 90+ importers read funders, ministries and universities' own recruitment systems (Workday, Oracle, PageUp, Stonefish and others) across about 100 countries.
  • Each member is matched by a hybrid scorer (dense embeddings, catalogue topics, field words). Eligibility is read as quoted facts from the official page and checked by deterministic rules; a fact whose quote is not on the page is dropped.
  • One Next.js app with 88 Prisma models, 14 scheduled jobs and 3,505 unit tests.

Research

JOY: a closed-loop model of how people watch film (MRes, UAL)
A closed-loop observer for film. It sees only a foveated percept, arbitrates between audiovisual salience and a vision-language model's reading of the scene, selects its own fixations with human-like timing, and perceives the world from wherever that choice left it. The main finding is a dissociation: a state-dependent policy that improves prediction of human gaze in 5 of 5 folds wins on only 3 of 8 clips once it controls the loop. Prediction and observation are different problems.

The system includes:

  • a gaze-contingent scanpath loop with inhibition of return and CRISP fixation durations
  • a LoRA-tuned Qwen2.5-VL that reads fixations out as coordinate tokens
  • persistent character identity and speaker grounding (BCubed F 0.972 / 0.985)
  • an engagement pipeline linking salience, event segmentation and goal inference
  • models of affective and pupil response

Project page · site source · research code available on request

JOY Companion
A real-time, fully on-device companion that perceives through a live camera (face identity, expression, objects, gaze), keeps a memory of the relationship, and talks through a local Qwen2.5 reasoning loop. Nothing leaves the machine.

MSPI-Tiny
Distils an offline audiovisual-attention model into interpretable decision-tree students for a live camera assistant, targeting under 100 ms per frame on edge hardware.

DinoSynthesis
A phylogenetic VAE-GAN (PyTorch) that interpolates between bird and reptile vocal latents to speculate on dinosaur sounds, with its own data pipeline for collection, SNR filtering and class rebalancing.

FILMDA Player
Real-time audience measurement from blinks and facial emotion. Built for my MTech thesis on AI-driven film analytics.

Writing

  • Rahulraj P. V., Sanil J., Anoop V. S., Asharaf S. Monetize the Dual: A Data Analytic Approach for Native Language and Prequel Movie Popularity Analysis. ICDAI 2023, Springer. doi
  • Narrative DNA: DNA-sequence inspired analysis of narrative dynamics in movie scripts. Under review, 2026.
  • JOY. MRes thesis on sequential visual attention in film, UAL, 2026.

Smaller experiments: GRAD0 (LLM news director) · LumiMeet · wind.ai · story-space · film_space_vr-

Pinned Loading

  1. DinoSynthesis DinoSynthesis Public

    Generative paleo-acoustics: a phylogenetic VAE-GAN in PyTorch that interpolates bird and crocodilian vocal latents to speculate on dinosaur sounds. Full data pipeline + Three.js explorer.

    Python 1

  2. enjoy enjoy Public

    JOY: a closed-loop model of film viewing that sees through a foveated percept and picks its own fixations. MRes thesis, UAL CCI. Finding: predicting gaze better ≠ looking better.

    HTML

  3. filmda.play filmda.play Public

    AI video player that measures viewer engagement in real time from blink detection and facial emotion, with a live analytics dashboard. Built for my MTech film-analytics thesis.

    Python

  4. GRAD0 GRAD0 Public

    AI news director: aggregates RSS news, uses LLMs (LangChain) to curate and script stories, and auto-matches stock footage to build a TV-style run of show.

    HTML

  5. lumi_meet lumi_meet Public

    LumiMeet: AI interview platform that generates tailored interview questions from your CV and the job description with Google Gemini. Node/Express backend proxy, Tailwind UI.

    Python

  6. mspi-tiny mspi-tiny Public

    Real-time perceptual-attention camera assistant: distils an offline audiovisual-attention model into interpretable decision trees for live, edge-device framing guidance (<100 ms target).

    Python