Charting the emergence of AGI?

  The recent appointment of General Paul Nakasone, former head of the National Security Agency (NSA), to OpenAI's board of directors has sparked widespread outrage and concern among privacy advocates and tech enthusiasts alike. Nakasone, who led the NSA from 2018 to 2023, will join OpenAI's Safety and Security Committee, tasked with enhancing AI's role in cybersecurity. However, this move has raised significant red flags, particularly given the NSA's history of mass surveillance and data collection without warrants. Critics, including Edward Snowden, have voiced their concerns that OpenAI's AI capabilities could be leveraged to strengthen the NSA's snooping network, further eroding individual privacy. Snowden has gone so far as to label the appointment a "willful, calculated betrayal of the rights of every person on Earth." The tech community is rightly alarmed, with many drawing parallels to dystopian fiction. The move has also raised questions about ...

  Adobe's recent update to its Terms of Service for Creative Cloud has sparked widespread concern among the creative community. The changes grant Adobe unprecedented access to users' projects, raising questions about privacy, copyright, and the very ownership of creative work. In this post, we'll delve into the key objections and legal implications of these new terms, and what they mean for professionals and individuals alike. Access to User Content: A Privacy Concern? Adobe's updated Terms of Service grant the company the right to access users' projects through automated and manual methods. While Adobe justifies this access as necessary for responding to support requests, detecting technical issues, and addressing security concerns, many users are uneasy about the potential for privacy violations and the unauthorised use of copyrighted material. This lack of transparency has led to fears that Adobe may use users' work to train its AI systems without their conse...

There have been some good attempts by organisations and individuals at developing policies on AI for third sector organisations. Some of the fundamental challenges that have been difficult to capture is the rapid evolution of AI. This rapid pace of AI development, particularly the potential for artificial general intelligence (AGI) by 2027/28 as suggested by scaling laws, poses significant challenges for charities in keeping their policies up-to-date. Here are some key considerations which may be of use to your organisation: Establish Principles and Ethical Frameworks Charities should establish clear principles and ethical frameworks to guide their use of AI, rather than relying solely on specific use cases or technical details that may quickly become outdated. These principles should align with the charity's mission, values, and commitment to beneficiaries, while addressing issues like transparency, accountability, privacy, and bias.[1][3] Adopt Agile and Iterative Policymaking Gi...

  Leopold Aschenbrenner's 'Situational Awareness, the decade ahead  Situational Awareness, the decade ahead . June 2024' may turn out to be the most significant publication on AI safety to date. Unlike a lot of theoretical musings from highly intelligent critics of AI systems this one has been written by an engineer, who was until recently employed by Open AI in the now disbanded former Super Alignment team.  It begins by discussing the rapid advancements in AI technology, particularly focusing on the progression from GPT-2 to GPT-4 models. It highlights that AI capabilities are evolving at an exponential rate, and there are predictions that by 2027, AI models could match or even surpass the work of human AI researchers and engineers. The text underscores the importance of understanding the trendlines in compute, algorithmic efficiencies, and unlocking latent capabilities for future AI development. Additionally, the document mentions the potential risks and challenge...