Language Selection

English French German Italian Portuguese Spanish

New Content/Layout OK?

Yes
95% (21 votes)
No
5% (1 vote)
Total votes: 22

Varnish Proxy

Silly me, a poll would not work on the new server. I forgot that with the Varnish cache proxy at the front almost all visitors arrive from the same IP address (the proxy), which means that Drupal would allocate just one vote to all (except registered and presently logged in users). With Drupal upgrade we can perhaps find polling software that overcomes this.

rpaf

You must use mod_rpaf to fix this problem that Varnish introduces.
See eg https://www.varnish-cache.org/lists/pipermail/varnish-misc/2008-September/016470.html
mod_rpaf for EL6 64bit here: http://centos.alt.ru/repository/centos/6/x86_64/mod_rpaf-0.6-2.el6.x86_64.rpm

Proxy

Thank, we will look into it. Currently, a lot of stuff other than the poll (e.g. views being counted) are not compatible with Varnish and it makes it look as though not many people visit and can participate in the site.

For sheer stats you could use

For sheer stats you could use an external (i.e. not cached by varnish) service, such as Google Analytics or run your own Piwik.

Piwik

Google Analytics is spyware, but Piwik would be a possibility (Stallman recently told me that it's good). Can it be installed on a cache proxy? I'd have to gain access to it first. Either way, this would not facilitate per-post page request count. Susan had it set up with a module, but it's no longer working correctly. In turn, rating/sorting posts by popularity is no longer possible, and that's the real downside (the front page can no longer list popular items for today).

The problem is not just that IP addresses are not unique. Some requests are never seen by the CMS and Apache.

For the non-unique addresses

For the non-unique addresses look at mod_rpaf, it was made for this situations.
Is this drupal6 or 7? With 6 varnish integration sucks from what I've seen.

See also
https://drupal.org/project/varnish
https://fourkitchens.atlassian.net/wiki/display/TECH/Configure+Varnish+3+for+Drupal+7

Agreed on Google Analytics. You can just install Piwik on the same host and tell Varnish either not to cache it or you can just set its virtualhost on a port other than 80 so it bypasses Varnish completely.

Varnish

Thanks for the pointers.

Yes, it's Drupal 6 and there are other issues that I am beginning to see, such as lack of updates from the RSS feeds around the page (I am currently investigating this, maybe it's related to a cron job or module config although I very much doubt the latter as I haven't changed configs).

Non-unique addresses could be bypassed as an issue even by writing random IP addresses, but that would enable easy poll rigging. I guess it's not essential for operation of the site, but it's a nice-to-have...

From Drupal.org: "This module provides integration between your Drupal site and the Varnish HTTP Accelerator, an advanced and very fast reverse-proxy system. Basically, Varnish handles serving static files and anonymous page-views for your site much faster and at higher volumes than Apache, in the neighborhood of 3000 requests per second."

I have had such issues with Varnish on top of WordPress and MediaWiki (pages served improperly from cache) and it all makes me wonder if removing Varnish altogether is the best way to proceed.

As for Piwik, I have never tried it before, so I will look into it.

I would keep Varnish on for

I would keep Varnish on for static files (css, js, jpeg etc) and to clean up HTTP traffic (Varnish will not forward incomplete or malformed HTTP requests to the backend, it should also be the front line against synfloods etc).

Here's a sample of what I use (test it first, I'm just beginning with Varnish myself)

director default dns {
.list = {
.port = "8080";
.connect_timeout = 5s;
.first_byte_timeout = 600s;
.between_bytes_timeout = 600s;
.max_connections = 10000;
"172.16.1.53"/32;
}
}
sub vcl_recv {
if (req.url ~ "\.(png|gif|jpg|swf|css|js)$") {
return(lookup);
}
}
sub vcl_fetch {
if (req.url ~ "\.(png|gif|jpg|swf|css|js)$") {
unset beresp.http.set-cookie;
}
if (req.restarts == 0) {
if (req.http.x-forwarded-for) {
set req.http.X-Forwarded-For =
req.http.X-Forwarded-For + ", " + client.ip;
} else {
set req.http.X-Forwarded-For = client.ip;
}
}
}

Then install mod_rpaf and make sure your Apache is listening on port 8080 and add this to /etc/httpd/conf.d/rpaf.conf:
LoadModule rpaf_module modules/mod_rpaf-2.0.so

RPAFenable On
RPAFproxy_ips 127.0.0.1 IPs_OF_THE_SERVER
RPAFsethostname On
RPAFheader X-Forwarded-For

PS: looks like drupal is messing with my comments, here's a text version http://fpaste.org/74672/raw/

Thanks

Thanks, I will look at it and into it in the weekend.

RSS feeds

The Piwik demo looks impressive, I have just given them a word of endorsement.

I am still trying to resolve some other issues we've identified.

I think I found the source of the issue above (RSS feeds). It seems like any external site access is denied by default, which helps explain why RSS feeds cannot be retrieved by the Drupal part of the site:


[root@tuxmachines ~]# wget lxer.com
--2014-02-05 04:34:37--  http://lxer.com/
Resolving lxer.com... 108.166.170.174
Connecting to lxer.com|108.166.170.174|:80... failed: Connection refused.
[root@tuxmachines ~]# wget linuxtoday.com
--2014-02-05 04:34:54--  http://linuxtoday.com/
Resolving linuxtoday.com... 70.42.23.121
Connecting to linuxtoday.com|70.42.23.121|:80... failed: Connection refused.

Looks like a firewall issue

Looks like a firewall issue at the first glance.

Firewall

Nux wrote:

Looks like a firewall issue at the first glance.

Yes, it was a simply issue to tackle. It works now.

Pageview count and polls

I'll have a look and see if configuration can solve not just the polling issue but also pageview count. The site of this module is down and it seems like it may require configuration on the cache server too.

More in Tux Machines

Linux Foundation: OpenContrail, SDNs, ONAP

  • Juniper Flips OpenContrail To The Linux Foundation
    It’s a familiar story arc for open source efforts started by vendors or vendor-led industry consortiums. The initiatives are launched and expanded, but eventually they find their way into independent open source organizations such as the Linux Foundation, where vendor control is lessened, communities are able to grow, and similar projects can cross-pollinate in hopes of driving greater standardization in the industry and adoption within enterprises.
  • Juniper Hands OpenContrail SDN to Linux Found. Before It's Too Late
    After failing to develop a community around the project and receiving pushback from a major backer, Juniper may be saving Contrail from becoming irrelevant
  • CableLabs Announces Two Open Source Projects for NFV
    SNAPS is an overarching program at CableLabs to facilitate the adoption of software-defined networking (SDN) and network functions virtualization (NFV) within the CableLabs’ community. The organization says it spearheaded SNAPS to fill in gaps within open source to ease the adoption of SDN and NFV for its cable members.
  • Bell becomes first operator to launch ONAP in production
    Canadian telecommunications company Bell announced it has become the first company to launch an open source version of the Open Network Automation Platform (ONAP) in production. The announcement was noted by Arpit Joshipura, general manager of networking and orchestration at the Linux Foundation, in a company blog post. According to Joshipura, the news marks a first step toward using ONAP as a common platform across Bell’s network as the company re-aligns itself to follow a multi-partner DevOps model.

OSS/Sharing Leftovers

  • Chrome 64 Beta: stronger pop-up blocker, Resize Observer, and import.meta
  • Chrome 64 Beta Brings Stronger Pop-Up Blocker, JavaScript Improvements
    Ahead of the holidays Google has pushed out the Chrome 64 beta to all supported platforms.
  • The Apache Software Foundation Announces Apache® Hadoop® v3.0.0 General Availability
    The Apache Software Foundation (ASF), the all-volunteer developers, stewards, and incubators of more than 350 Open Source projects and initiatives, today announced Apache® Hadoop® v3.0.0, the latest version of the Open Source software framework for reliable, scalable, distributed computing.
  • Open source science: Scientists researching rice plant genetics agree to not file for patents
    The Foundation for Food and Agriculture Research (FFAR), a nonprofit established in the 2014 Farm Bill with bipartisan congressional support, awarded a $1 million Seeding Solutions grant to University of California, Davis (UC Davis) to study the genetics of rice plants. Together with researchers at the University of North Carolina and collaborators, the team will develop and implement a chemistry-driven gene discovery approach to identify genes that modulate root traits.
  • Lytro could open source their light-field photo sharing platform
  • Lytro considering open source light field photo sharing platform
    Lytro is reportedly considering an open source solution after announcing it would no longer support its sharing platform for Lytro cameras’ ‘living images.’
  • When Waze Won't Help, Palestinians Make Their Own Maps
    If you want to drive the 15 or so miles from Jerusalem to the city of Jericho, in the Palestinian Territories, Google Maps will tell you: “Can’t find a way there.” Waze will issue a warning: “Caution: This destination is in a high risk area or is prohibited to Israelis by law.” If you press “Confirm Drive” nonetheless, the app will direct you, just not all the way. When you pass from Israel into the West Bank, part of the occupied Palestinian Territories, Waze’s directions simply end. To keep going, you need to change your setting to allow access to “high risk” areas. Even then, GPS coverage tends to be limited.
  • Using Gmail with OAUTH2 in Linux and on an ESP8266
    One of the tasks I dread is configuring a web server to send email correctly via Gmail. The simplest way of sending emails is SMTP, and there are a number of scripts out there that provide a simple method to send mail that way with a minimum of configuration. There’s even PHP mail(), although it’s less than reliable.
  • Simplicity Before Generality, Use Before Reuse
    A common problem in component frameworks, class libraries, foundation services, and other infrastructure code is that many are designed to be general purpose without reference to concrete applications. This leads to a dizzying array of options and possibilities that are often unused or misused — or just not useful. Generally, developers work on specific systems; specifically, the quest for unbounded generality rarely serves them well (if at all). The best route to generality is through understanding known, specific examples, focusing on their essence to find an essential common solution. Simplicity through experience rather than generality through guesswork.
  • What Ruby Needs
    Of all of the questions we receive at RedMonk, one of the most common concerns programming languages. Whether from members of a given community or a commercial entity, the desire is to better understand a given language’s trajectory and the context around it. Is it going up or down, and what are the reasons for that direction? And, of course: can that direction be meaningfully changed? Recently, we’ve received several such inquiries around Ruby. For those with an interest in the language, then, the following is a quick public summary of the answers we’ve been providing privately.
  • HTML 5.2 is done, HTML 5.3 is coming
    Today W3C releases HTML 5.2. This is the second revision of HTML5, following last year’s HTML 5.1 Recommendation. In 2014 we expressed a goal to produce a revision roughly every year; HTML 5.2 is a continuation of that commitment. This Recommendation like its predecessor provides an updated stable guide to what is HTML. In the past year there has been a significant cleanup of the specification. We have introduced some new features, and removed things that are no longer part of the modern Web Platform, or that never achieved broad interoperability. As always we have also fixed bugs in the specification, making sure it adapts to the changing reality of the Web. Many of the features added integrate other work done in W3C. The Payment Request API promises to make commerce on the Web far easier, reducing the risks of making a mistake or being caught by an unscrupulous operator. New security features such as Content Security Policy protect users more effectively, while new work incorporated from ARIA helps developers offer people with disabilities a good user experience of their applications.

Games: SteamOS Birthday, Best Linux Games of 2017, Finding Paradise

  • It's Been Four Years Since SteamOS Began Shipping With Not Much To Show
    It was four years ago this week that Valve began shipping SteamOS, their Debian-based Linux distribution intended for Steam Machines and those wanting a gaming-oriented Linux distribution. While Valve still technically maintains the SteamOS Linux distribution, the outlook at this point is rather bleak. For our coverage from four years ago when Valve began shipping SteamOS 1.0 based on Debian Wheezy, see SteamOS Compositor Details, Kernel Patches, Screenshots, Former NVIDIA, Microsoft Developers Doing Lots Of The SteamOS Work, and The First NVIDIA GeForce Benchmarks On The SteamOS Beta.
  • 7 Best Linux Games of 2017
    We take a look at the best Linux games of 2017, ranging from AAA titles to introspective indie hits. So park your gamepad, pop your feet up, and raise a glass of something socially acceptable to what’s been another terrific year for Tux fans with twitchy thumbs!
  • Finding Paradise Available Now for PC, Mac, and Linux
    Canadian indie game studio Freebird Games has released Finding Paradise, a spiritual successor to the studio's hit game To the Moon. You can check out the game's release date trailers below, the first being slightly less of a "serious" trailer:

OSS: Blockchain, Avast, Predictions, GreenKey

  • Startup Aims to Build Open-Source Telecom Ecosystem on Blockchain
    There are 2,000+ mobile network operations in charge of providing communication services at global scale. However, the traditional infrastructure is centralized, inflexible and inaccurate. Common services like 3G/4G, Wi-Fi, BOSS mobile communications solutions and companies that use cloud-based communications solutions are often unable to render accurate content billing and distribution. Conventional mobile packages overcharge customers, not to mention that they pose concerns around data transmissions. An alternative solution to average mobile network providers could be Blockchain technology.
  • Merry Xmas, fellow code nerds: Avast open-sources decompiler
    Malware hunting biz and nautical jargon Avast has released its machine-code decompiler RetDec as open source, in the hope of arming like-minded haters of bad bytes and other technically inclined sorts with better analytical tools. As discussed as the recent Botconf 2017 in France earlier this month, RetDec provides a way to turn machine code – binary executables – back into an approximation of the original source code.
  • 10 open source predictions for 2018
    With 2017 just about done and dusted, dozens of open source experts have polished their crystal balls and made predictions about what can be expected in the open source space in 2018. Now it's our turn. (With fingers firmly crossed) here are 10 open source trends that you may – or may not – see coming to the fore next year. Some are obvious, some are frivolous, and some could just change your life.
  • Stop Calling Everything "Open Source": What "Open Source" Really Means
    "Open source" is an exciting concept in the world of software and beyond. But it shouldn't be applied to contexts where it makes no sense.
  • GreenKey to join Symphony; open source voice software
    GreenKey, creator of patented voice software with integrated speech recognition designed for the financial markets, today announced the firm has joined the Symphony Software Foundation, a nonprofit organization fostering innovation in financial services through open source software (OSS).
  • GreenKey Joins the Symphony Software Foundation; Will Open Source Voice Software
    GreenKey, creator of patented voice software with integrated speech recognition designed for the financial markets, today announced the firm has joined the Symphony Software Foundation, a nonprofit organization fostering innovation in financial services through open source software (OSS). GreenKey will release a Community Edition of its voice software development kit (SDK) that will enable banks and other financial market firms to "voice enable" any web application.