Saurabh --e/🐍

517 posts

Saurabh --e/🐍 banner
Saurabh --e/🐍

Saurabh --e/🐍

@ghostedglory

Everything backend and ML Infra and Deployment

New Delhi Katılım Ekim 2023
96 Takip Edilen45 Takipçiler
Sabitlenmiş Tweet
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
Unfortunately we are moving with oth...
GIF
English
0
0
0
1.1K
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
I said "why can't I do the same with my get_admin_user"(yeah I know stupid) It suggested something along the lines of using a boolean flag like admin=true, embedding it in the header, and encrypting it with JWT. Its called as stateless authorization.
English
0
0
0
8
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
I accidentally learned how to embed information in my header that reduces a database call :- it checks if the current user is an admin of a tenant. I was working on some code, where ChatGPT suggested caching the Redis client formation, I was like "sure, that makes sense" - then
English
2
0
2
27
dirag
dirag@diragb·
finally, finished setting up the authentication microservice for @slopmuter. i'm currently only considering google oauth + oidc for this, through signing in with twitter will also be a feature in future releases. github.com/diragb/slopmut…
English
1
0
4
60
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
building a multi-tenant LLM gateway (BYOK, Redis already in stack) rate limiting for v1 — per-tenant or per-user or both? both is cleaner long-term but it's v1. no real users yet. leaning tenant-only and shipping. what would you do?
Saurabh --e/🐍@ghostedglory

Building Gatewise, a multi-tenant LLM gateway from scratch · Tenants bring their own API key (BYOK) · Keys stored AES-encrypted, never exposed · Rate limiting per tenant via Redis · Semantic cache with pgvector · Full usage + cost tracking FastAPI + PostgreSQL + Redis

English
1
0
3
73
Manan Ahuja
Manan Ahuja@mananahuja73·
Even though my college has a design department, me being a designer, I am from the btech department ironically. The funniest part is the students from the design department are asking for my help to design themselves a landing page and websites. Like, come on guys, you are from the design department nd you’re asking a btech guy?
English
1
0
4
57
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
@diragb They should go back to choosing the lowest-end devices and developing software for them instead of optimizing for the latest chips.
English
0
0
1
10
dirag
dirag@diragb·
@ghostedglory im so glad LLMs have made it easier to ship faster and more efficient software than before. /s
English
1
0
2
13
dirag
dirag@diragb·
i blame the hardware engineers and silicon innovators of the world for making machines so incredibly fast and efficient softwarebros got comfortable with shipping bloated slop as a professional standard.
English
1
0
6
29
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
@VazeKshitij I feel you, but eventually once there is an abundance of it you will do something similar.
English
0
0
1
19
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
@MickDeBoer @justinskycak "The man who never stops wins. Momentum is a weapon, don't drop it. Every step you take forward kills a piece of your old self."
English
0
0
0
5
Mick de Boer
Mick de Boer@MickDeBoer·
@justinskycak Action kills anxiety. Do something small everyday, but start today. The momentum you create will carry you forward. Not starting keeps you stuck.
English
1
0
1
68
Justin Skycak
Justin Skycak@justinskycak·
The longer you wait to build the life you want, the more likely you are to settle for the one you have.
English
5
17
241
4.1K
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
Building Gatewise, a multi-tenant LLM gateway from scratch · Tenants bring their own API key (BYOK) · Keys stored AES-encrypted, never exposed · Rate limiting per tenant via Redis · Semantic cache with pgvector · Full usage + cost tracking FastAPI + PostgreSQL + Redis
Saurabh --e/🐍 tweet media
English
0
0
1
105
Saurabh --e/🐍
Saurabh --e/🐍@ghostedglory·
@diragb Yes that sounds like the way to go about. I have been using aws for little tasks like deploying my ML models and using the s3.
English
0
0
1
25
dirag
dirag@diragb·
@ghostedglory just play around with it! i think going through mountains of documentation before getting to use the actual thing is a lot like premature optimization. play with it, ask claude, be curious, refer to docs when needed. you'll fail and make mistakes, but you'll overcome them.
English
1
0
2
11
dirag
dirag@diragb·
it's embarrassing, but i used to be scared of working with things like docker, k8s, aws, etc. because in my mind, they seemed too complex. i was also quite risk averse, probably because of my childhood. i overcame those fears by giving myself the permission to fail, and by playing around with them.
English
2
0
7
355
Mrinal
Mrinal@Hi_Mrinal·
I think I am not doing enough, these contract work or gig based work won't challenge me enough But what is the solution for this joining somewhere like a startup or an org ... Yaay ... But but kinda not doing well with this interview stuffs too Need to figure it out soon :)
English
12
0
166
7K
Saurabh --e/🐍 retweetledi
Justin Skycak
Justin Skycak@justinskycak·
Get good. You can't do anything big unless you have big skills.
English
8
10
233
4.7K
Arnav Kamath
Arnav Kamath@arnkamath·
On my last job, we often had to extract PDF tables manually because none of the market solutions were good enough. Will start working on a solution for that soon.
English
1
0
0
55