Workflow Automation & AI Evaluation QA
I am Shivam Sharma. I test integrations the way they actually break: duplicate webhooks, replayed events, malformed payloads, silent retries. I also review Hindi and English AI output against a rubric. Social media marketing and short-form content is a secondary service I still offer.
Open to remote hourly work in API/webhook QA, AI output evaluation, and Hindi/English data review.
Two separate services. Personal portfolio, open to freelance and remote hourly work.
Social Media & Content
Reels, hooks, captions, local promotions and content planning.
See social workAI Automation & Workflow QA
Node.js, REST APIs, webhooks, validation, retries, idempotency, logs and AI output review.
See automation workThree things I do, in order of focus
Technical QA and automation first. AI evaluation second. Social media as a secondary service.
1. API and webhook reliability QA, workflow automation. I write JavaScript and Node.js to test what happens when an integration misbehaves: the same webhook arriving twice, a payload missing a field, a delivery that failed and got retried. I have three personal open-source demos on GitHub that show exactly how I handle those cases.
2. Hindi and English AI evaluation and data review. I read and write both languages, so I can judge whether an AI answer is correct, follows the rubric, and sounds natural to a real speaker. I write short edge-case notes instead of silently picking a label.
3. Social media marketing and short-form content. A secondary service. Local promotional videos and content planning, mostly through Instagram, plus the campaign work listed further down this page.
Personal open-source work you can read right now
All three are personal projects built with synthetic data. Not paid client work, and not running in anyone's production system.
LeadOps Intake & Triage
Validates and normalizes lead webhooks, blocks duplicate processing, classifies sales, support and spam, assigns priority, retries failed mock deliveries, writes a mock CRM record, and routes uncertain cases to human review.
- Webhook validation and normalization
- Duplicate processing blocked (idempotency)
- Sales, support, spam classification
- Priority assignment and retry on failed mock delivery
- Mock CRM record write
- Uncertain cases routed to human review
Event Reliability Lab
A place where I test how event delivery breaks and how to handle it safely: signed webhook validation, schema checks, idempotency, retries, dead-letter handling, and redacted audit logs.
- Signed webhook validation
- Schema checks on incoming payloads
- Idempotency keys
- Retries with backoff
- Dead-letter handling
- Redacted audit logs
API Contract Drift Monitor
Compares an API against its OpenAPI contract and prints test output that a human can actually read, so a breaking change is obvious before it ships.
- OpenAPI contract checks
- Detects drift between spec and responses
- Readable test output
These repositories use synthetic data only. They are personal open-source demos of how I test and automate integrations, not client deliverables and not production systems.
Hindi and English, judged against the rubric
What I can do today. I am not claiming years of professional annotation work I cannot show you.
Hindi and English language review
I read both fluently, so I can tell when a translation is technically correct but sounds wrong to a real speaker.
Classification against a rubric
I follow the rubric as written, and I flag the cases where the rubric itself is unclear instead of guessing quietly.
Edge-case notes
Short written notes on the inputs that sit between two labels, with why I picked the one I picked.
Expected versus actual feedback
What the model should have said, what it actually said, and the smallest change that would fix it.
QA passes on batches
Re-checking a sample of completed items for consistency and label drift.
Reproduce, test edges, document, suggest a fix
Reproduce
Get the failure to happen again on purpose, with the exact request, payload and steps written down.
Test edge cases
Empty fields, wrong types, duplicates, replays, timeouts, and the slightly-off payloads nobody sends on purpose.
Document failures
Expected versus actual, status codes, logs with secrets redacted, and how often it happens.
Suggest a safe fix
The smallest change that fixes it without breaking the callers already depending on the old behaviour.
What is actually on this page
Personal open-source work, language ability, and availability. No claimed reach or guaranteed results.
What I have actually done
- • Build small Node.js services that validate, normalize and route webhook events.
- • Test the failure paths: duplicates, replays, bad schemas, failed deliveries, dead letters.
- • Check APIs against their OpenAPI contract and print readable results.
- • Write it all up in public on GitHub, using synthetic data.
- • Discord community management and moderation.
- • Minecraft server configuration and day-to-day troubleshooting.
- • Linux and VPS setup, updates and basic troubleshooting.
- • Performance checks when players report lag or downtime.
- • Access and permission handling for members.
- • Community support: reading reports, reproducing them, and following up.
- • VMart promotional video (2025), a portfolio example.
- • Local event promotion (March 2026), a portfolio example.
- • Reels, hooks and captions for short-form promotional content.
- • Local promotions and simple content planning.
- • Public examples are posted on @just_shivuh. No claimed reach or guaranteed results.
Technical projects first, campaigns after
The three repositories are personal open-source demos built on synthetic data.
LeadOps Intake & Triage
Validates and normalizes lead webhooks, blocks duplicate processing, classifies sales, support and spam, assigns priority, retries failed mock deliveries, writes a mock CRM record, and routes uncertain cases to human review.
View on GitHubEvent Reliability Lab
A place where I test how event delivery breaks and how to handle it safely: signed webhook validation, schema checks, idempotency, retries, dead-letter handling, and redacted audit logs.
View on GitHubAPI Contract Drift Monitor
Compares an API against its OpenAPI contract and prints test output that a human can actually read, so a breaking change is obvious before it ships.
View on GitHubToothcraft Dental Care, Website & Local Service Experience
Self-hosted website project for a Bhagalpur dental practice. I worked on clear service information, local contact and appointment paths, and the community-work presentation. The site is hosted on my home server. This is not claimed as paid client work, and no traffic, conversions or other results are claimed.
Visit live siteSignalBrief, Trend-to-Post Evidence Desk
Working with synthetic trend records: evidence checks, safety flags, scoring and a human review brief as the output. A concept I am building for myself, not client work and not finished.
ReportProof, Social Media Reports You Can Explain
CSV import, data quality checks, formulas you can read, period comparison and an editable report export. A concept I am building for myself, not client work and not finished.
VMart promotional video (2025)
A short promotional video: shot list, edit, hook and caption. Shared as a portfolio example, not paid client work, and with no claimed results.
Local event promotion (March 2026)
A promotional reel and captions for a local event in Bhagalpur, planned around the date, place and a simple call to action.
TrashMCPE, my own platform and community
This is my own project, not paid client work. It is where I picked up server operations, troubleshooting and community support alongside the branding side.
TrashMCPE
An online gaming platform and digital community with players from India and around the world. My own project, run end to end.
trashmcpe.in is our live store. Players come here to buy ranks, cosmetics and upgrades for their tools and gameplay.
TrashMCPE is an online gaming platform where people join a multiplayer experience, take part in community events, and buy premium memberships and digital products.
I built it from scratch. The branding, the marketing, the community, the user experience, the content, and the store. Everything you see is something I figured out and shipped.
Created the logo, colors, tone and overall look that carried across Discord, Reddit, Instagram and the store.
Set up the Discord server, roles, moderation and onboarding, then used Reddit posts to bring in the first organic members.
Built two separate buying flows, one for Indian users and one for international users, with clear pricing and premium membership tiers.
Ran seasonal campaigns, launch pushes, events and creatives that turned first-time visitors into repeat buyers.
- Built separate purchasing experiences for Indian and international users
- Designed premium membership positioning
- Created launch campaigns
- Planned seasonal marketing campaigns
- Managed community announcements
- Created promotional creatives
- Built trust through consistent branding
Multiplayer experience, events, and premium memberships.
- Built an online community around a niche gaming product, from zero members to an active player base.
- Created a brand identity people actually recognize.
- Ran campaigns that got people talking, joining, and coming back.
- Handled everything from the branding to the daily community operations.
The domain is the case study.
This portfolio isn't sitting on some random .com or a hiring site subdomain. It lives on portfolio.trashmcpe.in, a subdomain of TrashMCPE, my first digital community and online gaming platform with players from India and abroad. The brand is officially registered with Udyam (Government of India, MSME). This isn't a side project. It's a real registered venture I own and run myself.
The domain, DNS, branding, storefronts for India and global users, Discord community, and even this portfolio are all managed by one person: me. Hosting my proof of work on the brand itself is my way of showing, not just telling.
Always learning, always shipping
Tools, tactics and thinking
Things I actually use on real campaigns, not a list I copied from a job description.
The short version
I break things on purpose
Duplicates, replays, malformed payloads, timeouts. If an integration can fail quietly, I want to find it first.
My bug reports are usable
Steps to reproduce, expected versus actual, and logs with anything sensitive redacted.
You can read my code today
Three personal open-source demos on GitHub, built with synthetic data. No NDA needed to see how I work.
Hindi and English both
Useful for AI output review, data annotation and anything where a translation has to sound human.
I say when I am unsure
Uncertain cases get flagged for human review instead of a confident guess.
I pick up tools fast
New API, new rubric, new tool. I read the docs, test the edges, and get going.
Where the work lives
GitHub for the code. LinkedIn for the profile and certifications. Instagram for short-form content, which is my secondary service.
GitHub
Three personal open-source demos on webhook validation, event reliability and API contract checks. Synthetic data, readable test output.
Open GitHubMy profile, certifications and write-ups. This is where the three certifications listed above can be verified.
Secondary service: short promotional videos for local businesses and content planning.
Open InstagramA working stack, not a showcase
Three separate CVs, one for each kind of role
These are not one combined job history. Pick the CV that matches the role you are hiring for. Personal projects are labelled as personal work with synthetic data, not paid client work.
Let's build something worth talking about
Best for freelance projects, content retainers, workshops and campaign consulting.
Social Media & Content Strategy
I plan and create short-form promotional content for local businesses, cafés, food brands, events, and community projects. My work focuses on hooks, reels, captions, local discovery, and simple calls to action.
Reels and short-form promotional videos
Shoot lists, edits and hooks made for a phone screen.
Local business content planning
A simple monthly plan a café or shop owner can actually keep up with.
Event and launch promotion
Countdown posts, reminder stories and a clear ask to book or show up.
Captions, hooks and location-based campaign ideas
Openers, local hashtags and city-specific angles that help people find the place.
Instagram content review and improvement
A pass over an existing profile: what to keep, what to cut, what to try next.
Public examples of reels, hooks, captions and local promotions. Shared as portfolio work, not as paid client work, and with no claimed reach or guaranteed results.
Examples
VMart promotional video (2025)
A short promotional video put together for VMart: shot list, edit, hook and caption. Shared as a portfolio example, not presented as paid client work or a measured result.
Local event promotion (March 2026)
Promotional reel and captions for a local event in Bhagalpur, planned around a clear date, place and a simple call to action. Portfolio example only.
@just_shivuh public portfolio
My public Instagram profile, where reels, hooks, captions and local promotions I make are posted. Public examples only, with no claimed reach or guaranteed results.
Open on InstagramOpen to short-form content, local promotions, and social media support for businesses and creators.
View social work on Instagram