Show HN: Proxy Block-CAGE, a new sparse block attention

2 points by iqbal1980 16 days ago · 0 comments · 1 min read

Hi, I'm a PhD student in Bioinformatics/Computational Biology with a software engineering background,

I'm trying to pivot toward AI/ML research. I'm familiar with the practical side of AI as in using, Scikit learn, R, Pytorch, ONNX Runtime etc...

I was thinking if LLMs could be used as a research assistant to create better AIML algorithms. So I asked ChatGPT to help find better way to solved one of the most computationally intensive problems in Transformer architecture based model. I instructed ChatGPT to use genetic algorithms, genetic programming and other optimization techniques (Something I use extensively in my bioinformatics research) to find better Attention methods in transformers and this was the result. I would love to get feedback and comments from the AIML research community. Please read the md file and get back to me.

Hope you find this useful.

Thank you

No comments yet.