Solutions are always tailored to specific problems. There’s no one-size-fits-all approach. The techniques vary depending on needs like the level of customization, available data sources, and system complexity. The strategy should be based on these factors. Here are a few alternative approaches we can consider, if RAG is optional:
Embedding-Based Search with Pretrained Models: This is a relatively easy approach to implement, but it doesn’t offer the same capabilities as RAG. It works well when simple retrieval is enough and there’s no need for complex reasoning.
– Knowledge Graphs with AI Integration: Best for situations where structured reasoning and relationships are key. It requires manual effort and can be tricky to integrate, but it offers powerful semantic search capabilities and supports reasoning tasks.
– Fine-Tuned Language Models: This is ideal for stable, well-defined datasets where real-time data isn’t crucial. Since the data is straightforward, generating responses is easier. It performs well when the data is comprehensive but may struggle with queries outside the trained data.
– Hybrid Models: A mix of retrieval and in-context learning. While it’s a bit more complex to implement, it delivers high accuracy and flexibility because it combines different techniques. Use this when you need high accuracy and rich content.
– Multi-Modal Models: These models handle different types of data (eg., images, text) and provide combined insights. For example, they can retrieve images from documents and analyze them. However, they require solid infrastructure, which can get expensive.
– Rule-Based Systems: These expert systems rely on predefined rules to generate responses. They’re great for regulated industries like finance & legal, as they offer transparency and auditability. However, they’re typically not scalable and may not handle unstructured data effectively.
– End-to-End Neural Networks (for Q&A): These models are trained specifically for question-answering tasks. They perform well for defined tasks like Q&A and give concise answers without the need for complex pipelines. But they require large, annotated datasets and may underperform if there isn’t enough related data.
Since this field is still evolving, it’s important to stay on the lookout for new or improved techniques based on the specific requirements
Why some professional certifications are not trustworthy in some countries?
Read the original article I wrote in LInkedIn here.
I was in a brainstorm meeting to design a new training program for developers, and one suggestion was to have a mandatory certification as part of evaluation criteria. Most of us were not in agreement with the idea but a justification comment from one person caught my attention “certification exams are just memory tests!“.
Microsoft do not conduct Beta exams in few countries and it is clearly mentioned in the About page of Microsoft’s Certifications:
Candidates located in China, India, Pakistan, or Turkey are not eligible to participate in beta exams for security reasons.
In one of the Microsoft Community forums, a Microsoft agent even shown the courage to explain the reason that the fraud percentage in these countries are almost 80%. (sorry, I am unable to trace that page now. May be that comment was removed after some reporting)
“Certification in X is preferred” is one of the usual line in Job Descriptions, but the fact is interviewer do not really give a damn about the certification unless the candidate really showcases the skills. This fate definitely is not applicable for all the exams, I have to admit.
I took my PMP exam at an exam center Dubai, UAE where I felt like I was in a demilitarized zone where I am being monitored by ‘someone’ every microsecond. I was allotted a locker where I was asked to put all the belongings including my watch and belt there and I had to walk though a scanner. I was guided to a cubicle where an overhead CCTV camera was pointing at me like a gun. After about three months of study by spending almost 4-6 hours a day, I also practiced the exam by answering about 1000 questions to get confidence. Surprisingly I did not encounter same question repeated in my actual exam and, the amount of joy I felt when the last screen of “Congratulations” gave was very blissful.
Compared to my PMP, back in my home town, the few other exams I took (mostly Microsoft exams) at local exam centers were very casual. No strict checking of body or ID card, nobody to monitor, no strict adherence to timing etc.
But why?
When I say “certification exams are for testing memory”, what I am trying to imply is that, you get “brain dumps“, the exact exam questions and its answers in your hand in advance so your job is just to memorize those questions and answer options so you might even get 1000/1000 marks.
One of the problem with local exam centers is, along with exam vouchers selling and facilitating the exams, they are also giving, or selling brain dumps too. They use some kind of screen recorders, or other methods to collect questions. There are many people in social media like Telegram, through the exam preparation groups are giving/selling same. But now since the exam providers also allow candidates to attend exams from anywhere, it has become too easy to cheat the exam by collecting questions, or by using another methods like impersonation. There are many websites also provide brain dumps, in the name of practice questions.
See how easy is it to write a program to take screenshot every few seconds so that you can do a second attempt exam by memorizing these questions:
System.Drawing.Rectangle captureRectangle = Screen.AllScreens[0].Bounds;
System.Drawing.Graphics captureGraphics = System.Drawing.Graphics.FromImage(bmp);
captureGraphics.CopyFromScreen(captureRectangle.Left, captureRectangle.Top, 0, 0, captureRectangle.Size);
bmp.Save(path + “\\” + DateTime.Now.Ticks + “.mib”, System.Drawing.Imaging.ImageFormat.Jpeg);
Another cheating method is to use a ‘proxy’ person support. Using some screen sharing software, your friend/proxy can login to your machine remotely and attend the exam while you sit idle in front of the computer.
How to make these exams trustworthy?
Exam process and systems are improving and embracing latest technologies. With the introduction of AI, there are effective solutions available which will monitor candidate’s facial movements, eye contact, body language etc. in addition to improving the exam quality – by intelligent selection of questions or alternate evaluation methods. Also, in addition to multiple choice questions, if we can introduce practical-oriented exams also, then we can make the candidates ready for the industry. Scenario based questions do exist, but those are again memoizable. However, we might have to wait a while more because, at the time of writing this exam also, I can see there are exams which you can easily pass if you have the capability to memorize brain dumps.
Python Programming series in Malayalam–Part 3 | How computers think
Part-2 of Python Learning (Malayalam) Series has been published
You can Read the article here:
– പ്രോഗ്രാമിംഗ് പഠിക്കാൻ പഠിക്കാം – പൈത്തൺ പ്രോഗ്രാമിംഗ് ഭാഗം 2 – https://www.janmabhumi.in/read/python-programming-part-2/
– YouTube Video of the same: https://www.youtube.com/watch?v=rRZA2rCXzEs
All previous Parts – https://www.janmabhumi.in/admin-news-listing/?username=b19GgNpk1nCEhD9APPZ9Ch2RL0fgfM
May subscribe to playlist for updates on future parts – https://www.youtube.com/channel/UC3s4kM_Ov55FF02I5nQZB4g
Starting a Python Programming learning series in Malayalam
I am starting a new articles series, but this time in my regional language – Malayalam. Please find the link to the Part-01 of series below. Please read, support, send feedback and suggestions regularly.